Job Title: Python Developer (PySpark, AWS Glue)
Salary: Up to £45,000 per annum
Location: London, M-25
Job Type: Permanent
Start Date: ASAP

About the Role

We're looking for a talented Python Developer with strong experience in PySpark and AWS Glue to join our growing data engineering team. This is a fantastic opportunity for someone looking to work on modern data pipelines in the cloud, contributing to high-impact projects across a dynamic organisation.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and AWS Glue

• Work closely with data engineers, analysts, and architects to understand business requirements and implement efficient ETL processes

• Automate data ingestion, transformation, and integration workflows

• Optimise performance of large-scale data processing jobs

• Write clean, reusable, and testable Python code

• Monitor and troubleshoot pipeline performance and data quality issues

• Ensure best practices in code quality, testing, and documentation

Requirements

Essential:

• 2+ years of professional Python development experience

• Strong hands-on experience with PySpark for distributed data processing

• Proven knowledge and use of AWS Glue and other AWS data services (eg S3, Athena, Lambda)

• Familiarity with data lake architecture and modern ETL practices

• Experience working with structured and semi-structured data (eg, Parquet, JSON)

• Git version control and CI/CD familiarity

• Strong communication and collaboration skills

Desirable:

• Experience with other AWS services like Redshift, EMR, Step Functions

• Knowledge of SQL and data modelling principles

• Exposure to containerisation tools (eg, Docker) or orchestration (eg, Airflow)

• Understanding of data governance, lineage, and quality tools

What's on Offer

• Competitive salary up to £45,000

• Flexible working (Hybrid/Remote options available)

• Ongoing training and development opportunities

• Supportive team environment and modern tech stack

• Opportunity to work on exciting data-driven projects at scale