Job provided by Nigel Frank International
Share this job on social:
About the job
Jefferson Frank are currently working with a consultancy firm based in London and are seeking an experienced Data / Platform Engineer to work on a 6 month contract.
The client is working for a Public sector client who are looking to optimise their Big data strategy through using the latest technologies.
AWS (Networking, CloudFormation, IAM)
Cloudrea Hadoop Distribution / Cloudera / kafka
CI/CD pipelines (Git / Jenkins)
Orchestration and configuration management using Chef
Experience with Spark clusters, both permanent in Cloudera
Experience in large scale distributed processing architectures
Experienced in fault tolerant systems in AWS including Clustering & multi AZ deployments
Setting up + running Big Data clusters using Hadoop, Spark /Impala / S3 on AWS