Share this job on social:
About the job
Hadoop Team Lead sought to take ownership of our clients Hadoop cluster; developing, analysing, providing design recommendations and support for the delivery of high quality Big Data solutions and requirements across the organisations systems and platforms.
Day to day responsibilities:
Design and build big data solutions from supplied specifications, using agreed standards and tools, to achieve a wellengineered result.
Interact across the business to understand and identify data needs and requirements, working with other business functions to design, deliver and support the solutions to address those needs and requirements.
Be the technical lead in the evaluation and recommendation of software tools, definition of hardware requirements and system configurations working within architectural guidelines. Investigate information/data sources to establish the information available and assess the integrity; acting as expert support for production Hadoop environments.
Create, amend, and keep track of programs in accordance with the design and documents all work in accordance with agreed standards. Conducts tests of programs, corrects errors, and retests to achieve errorfree results.
*Provide specialist technical and application knowledge on data concepts, data modelling techniques and design principles. Maintains a detailed knowledge of big data architectures, software and facilities and their application in local use.
Skills & Experience:
Big Data Modelling; ETL processes
Hortonworks Hadoop (desirable)
Python, Spark R, Java (desirable)
Configuration Management; software testing tools (desirable)