Data Engineer
Data Engineer
5-month Contract
Location: Hybrid - London, Newcastle or Coventry (3 days per week onsite)
Rate: Up to £358 per day (Inside IR35)
Job Summary
We are seeking a skilled Data Engineer to support the development and implementation of advanced data solutions for a high-profile public sector organization. This role requires hands-on experience with Azure technologies, data transformation, and integration. The successful candidate will play a key role in building and optimizing data pipelines, integrating varied data sources, and contributing to innovative data solutions.
Key Responsibilities
- Develop and implement robust data solutions using the Azure technology stack (Data Factory, Data Lakes, Notebooks, Synapse Warehouse).
- Integrate and work with diverse data sources, including on-premises databases, Data Lakes, and ERP systems.
- Perform complex data transformations using PySpark and SQL, employing optimization techniques to ensure efficiency.
- Design and maintain scalable data models and implement warehousing concepts.
- Document data pipelines, processes, and models for future reference.
- Collaborate on API integration projects to enhance data connectivity and accessibility.
- Apply basic machine learning techniques to support predictive and analytical capabilities.
Preferred Skills
- Experience with Microsoft Fabric.
Essential Qualifications
- Practical expertise in Azure-based data engineering.
- Strong understanding of data modelling and warehousing principles.
- Proficiency in PySpark, SQL, and API integration.
- Demonstrated ability to work with varied data sources and complex data transformations.
- Effective data documentation and collaboration skills.
This is an exciting opportunity for a Data Engineer looking to contribute to meaningful projects within a dynamic environment. If you bring hands-on Azure experience and a passion for innovation in data solutions, we encourage you to apply.
Reference: 2850825087
Data Engineer
Posted on Nov 15, 2024 by Digital Skills Ltd
Data Engineer
5-month Contract
Location: Hybrid - London, Newcastle or Coventry (3 days per week onsite)
Rate: Up to £358 per day (Inside IR35)
Job Summary
We are seeking a skilled Data Engineer to support the development and implementation of advanced data solutions for a high-profile public sector organization. This role requires hands-on experience with Azure technologies, data transformation, and integration. The successful candidate will play a key role in building and optimizing data pipelines, integrating varied data sources, and contributing to innovative data solutions.
Key Responsibilities
- Develop and implement robust data solutions using the Azure technology stack (Data Factory, Data Lakes, Notebooks, Synapse Warehouse).
- Integrate and work with diverse data sources, including on-premises databases, Data Lakes, and ERP systems.
- Perform complex data transformations using PySpark and SQL, employing optimization techniques to ensure efficiency.
- Design and maintain scalable data models and implement warehousing concepts.
- Document data pipelines, processes, and models for future reference.
- Collaborate on API integration projects to enhance data connectivity and accessibility.
- Apply basic machine learning techniques to support predictive and analytical capabilities.
Preferred Skills
- Experience with Microsoft Fabric.
Essential Qualifications
- Practical expertise in Azure-based data engineering.
- Strong understanding of data modelling and warehousing principles.
- Proficiency in PySpark, SQL, and API integration.
- Demonstrated ability to work with varied data sources and complex data transformations.
- Effective data documentation and collaboration skills.
This is an exciting opportunity for a Data Engineer looking to contribute to meaningful projects within a dynamic environment. If you bring hands-on Azure experience and a passion for innovation in data solutions, we encourage you to apply.
Reference: 2850825087
Alert me to jobs like this:
Amplify your job search:
Expert career advice
Increase interview chances with our downloads and specialist services.
Visit Blog