HADOOP BIG DATA DEVELOPER

Start: ASAP
Duration: initial 6-months
Location: Hybrid, once per week in Windsor

Rate: inside IR35, paying up to £425 per day.

Responsibilities:
- Assess existing big data infrastructure
- Design and code Hadoop applications
- Create processing frameworks
- Extract and isolate data clusters
- Test scripts to analyse results

Skills required:
- Build and maintain data pipelines. Expertise in PySpark, Spark SQL, Hive, Python, Kafka
- Data collection, integration, scheduling, data storage and management, ETL processes
- Relational and non-relational databases (MySQL, PostgreSQL, MongoDB)