Azure Data Engineer

Azure Data Engineer

Location: Coventry - Hybrid - 3 days per week onsite

Start Date: ASAP

Contract Rate: £420 per day inside IR35

Duration: 6 to 12 months initially

Role Overview

Our client is seeking a highly skilled Azure Data Engineer to design, develop, and execute enterprise-scale data migration and transformation solutions within the Microsoft Azure ecosystem. The successful candidate will play a key role in building high-performance data pipelines, enabling scalable data processing, and supporting critical business data initiatives.

Key Responsibilities

* Design and build scalable ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines

* Develop structured data migration payloads, including schema mapping and transformation logic

* Implement Change Data Capture (CDC) for efficient incremental data loads

* Develop and maintain PySpark notebooks for data transformation, cleansing, and partitioning

* Build reusable Python utilities for data validation and API integrations

* Create and optimise SQL queries, stored procedures, and analytical data models

* Manage and integrate data across Azure Data Lake (ADLS Gen2), Synapse Analytics, and Azure SQL

* Design solutions for handling structured and semi-structured data formats such as JSON and Delta Lake

* Ensure performance optimisation, scalability, and reliability of data pipelines

* Support data quality, governance, and security best practices

Skills & Experience

Essential

* 5+ years’ experience in cloud data engineering, ideally within Azure

* Strong hands-on expertise with Azure Data Factory and Azure Synapse Analytics

* Advanced programming skills in Python, PySpark, and SQL (T-SQL / Spark SQL)

* Experience designing and implementing data pipelines and migration solutions

* Strong understanding of data modelling, transformations, and optimisation techniques

* Experience working with Azure Data Lake Storage (ADLS Gen2)

Desirable

* Experience with Azure Databricks

* Familiarity with Cosmos DB, Oracle DB, and Delta Lake

* Knowledge of event-driven architectures (Event Hub, Kafka, IoT Hub)

* Exposure to Microsoft Fabric / OneLake

* CI/CD experience with Azure DevOps or GitHub

* Understanding of data governance, data quality, and security frameworks

* Experience working with unstructured data and large-scale datasets

If you have the relevant skills and experience, please do apply promptly to be considered