Senior Data Engineer
Posted on Oct 30, 2024 by CV-Library
London, United Kingdom
IT
Immediate Start
£80k - £80k Annual
Full-Time
Senior Data Engineer
Data Bricks - ADF - Python - SQL
London or Bedford (x2 days a month)
Up to £80,000
My client, one of the largest healthcare organizations in the UK are expanding their data team to help transform their new health care data eco-system. They're embarking on a pivotal migration journey, moving from on-premises to the Azure cloud, and need an experienced Senior Data Engineer to help drive this transformation. This is an opportunity to make a real difference in the healthcare sector, impacting data systems that support critical decisions across the organization.
As a Senior Data Engineer, you’ll play a key role in their dynamic data team, focusing on building a new healthcare data ecosystem. Your expertise in designing, implementing, and optimizing data solutions will support their migration to Azure and facilitate high-quality data operations. You’ll be responsible for complex data structures, data modeling, and analysis, ensuring data is accessible, accurate, and efficient for both technical and non-technical stakeholders.
Responsibilities
* Lead the design and implementation of data pipelines and architectures in Databricks and Azure Data Factory.
* Develop robust data processing solutions in Python and PySpark, ensuring high efficiency and reliability.
* Use expert knowledge to design and develop ETL pipelines and cloud data storage solutions that meet business requirements, while also taking into consideration non-functional needs.
* Work closely with stakeholders across technical and non-technical backgrounds to understand data needs and provide optimal solutions.
* Ensure data integrity, quality, and accessibility across the new Azure-based healthcare ecosystem.
* Contribute to data modeling, data analysis, and migration strategies, with a focus on creating sustainable and scalable solutions.
* Collaborate with the wider data team to establish best practices in data structure, pipeline optimization, and performance tuning.
Requirements
* 6+ years in data engineering with a strong focus on cloud data migration projects:
* Proficiency with Databricks and Azure Data Factory.
* Advanced knowledge of Python and PySpark.
* Strong command of SQL for data transformation, cleaning, and manipulation
* Experience working in CI/CD, DevOps and agile delivery environments
* In-depth understanding of data structures and data architectures.
* Solid experience in data modeling and data analysis.
* Strong collaboration skills, with the ability to engage and influence both technical and non-technical stakeholders effectively.
If this sounds like the role for you hit APPLY & a consultant will be in touch
Data Bricks - ADF - Python - SQL
London or Bedford (x2 days a month)
Up to £80,000
My client, one of the largest healthcare organizations in the UK are expanding their data team to help transform their new health care data eco-system. They're embarking on a pivotal migration journey, moving from on-premises to the Azure cloud, and need an experienced Senior Data Engineer to help drive this transformation. This is an opportunity to make a real difference in the healthcare sector, impacting data systems that support critical decisions across the organization.
As a Senior Data Engineer, you’ll play a key role in their dynamic data team, focusing on building a new healthcare data ecosystem. Your expertise in designing, implementing, and optimizing data solutions will support their migration to Azure and facilitate high-quality data operations. You’ll be responsible for complex data structures, data modeling, and analysis, ensuring data is accessible, accurate, and efficient for both technical and non-technical stakeholders.
Responsibilities
* Lead the design and implementation of data pipelines and architectures in Databricks and Azure Data Factory.
* Develop robust data processing solutions in Python and PySpark, ensuring high efficiency and reliability.
* Use expert knowledge to design and develop ETL pipelines and cloud data storage solutions that meet business requirements, while also taking into consideration non-functional needs.
* Work closely with stakeholders across technical and non-technical backgrounds to understand data needs and provide optimal solutions.
* Ensure data integrity, quality, and accessibility across the new Azure-based healthcare ecosystem.
* Contribute to data modeling, data analysis, and migration strategies, with a focus on creating sustainable and scalable solutions.
* Collaborate with the wider data team to establish best practices in data structure, pipeline optimization, and performance tuning.
Requirements
* 6+ years in data engineering with a strong focus on cloud data migration projects:
* Proficiency with Databricks and Azure Data Factory.
* Advanced knowledge of Python and PySpark.
* Strong command of SQL for data transformation, cleaning, and manipulation
* Experience working in CI/CD, DevOps and agile delivery environments
* In-depth understanding of data structures and data architectures.
* Solid experience in data modeling and data analysis.
* Strong collaboration skills, with the ability to engage and influence both technical and non-technical stakeholders effectively.
If this sounds like the role for you hit APPLY & a consultant will be in touch
Reference: 222569307
https://jobs.careeraddict.com/post/96525128
Senior Data Engineer
Posted on Oct 30, 2024 by CV-Library
London, United Kingdom
IT
Immediate Start
£80k - £80k Annual
Full-Time
Senior Data Engineer
Data Bricks - ADF - Python - SQL
London or Bedford (x2 days a month)
Up to £80,000
My client, one of the largest healthcare organizations in the UK are expanding their data team to help transform their new health care data eco-system. They're embarking on a pivotal migration journey, moving from on-premises to the Azure cloud, and need an experienced Senior Data Engineer to help drive this transformation. This is an opportunity to make a real difference in the healthcare sector, impacting data systems that support critical decisions across the organization.
As a Senior Data Engineer, you’ll play a key role in their dynamic data team, focusing on building a new healthcare data ecosystem. Your expertise in designing, implementing, and optimizing data solutions will support their migration to Azure and facilitate high-quality data operations. You’ll be responsible for complex data structures, data modeling, and analysis, ensuring data is accessible, accurate, and efficient for both technical and non-technical stakeholders.
Responsibilities
* Lead the design and implementation of data pipelines and architectures in Databricks and Azure Data Factory.
* Develop robust data processing solutions in Python and PySpark, ensuring high efficiency and reliability.
* Use expert knowledge to design and develop ETL pipelines and cloud data storage solutions that meet business requirements, while also taking into consideration non-functional needs.
* Work closely with stakeholders across technical and non-technical backgrounds to understand data needs and provide optimal solutions.
* Ensure data integrity, quality, and accessibility across the new Azure-based healthcare ecosystem.
* Contribute to data modeling, data analysis, and migration strategies, with a focus on creating sustainable and scalable solutions.
* Collaborate with the wider data team to establish best practices in data structure, pipeline optimization, and performance tuning.
Requirements
* 6+ years in data engineering with a strong focus on cloud data migration projects:
* Proficiency with Databricks and Azure Data Factory.
* Advanced knowledge of Python and PySpark.
* Strong command of SQL for data transformation, cleaning, and manipulation
* Experience working in CI/CD, DevOps and agile delivery environments
* In-depth understanding of data structures and data architectures.
* Solid experience in data modeling and data analysis.
* Strong collaboration skills, with the ability to engage and influence both technical and non-technical stakeholders effectively.
If this sounds like the role for you hit APPLY & a consultant will be in touch
Data Bricks - ADF - Python - SQL
London or Bedford (x2 days a month)
Up to £80,000
My client, one of the largest healthcare organizations in the UK are expanding their data team to help transform their new health care data eco-system. They're embarking on a pivotal migration journey, moving from on-premises to the Azure cloud, and need an experienced Senior Data Engineer to help drive this transformation. This is an opportunity to make a real difference in the healthcare sector, impacting data systems that support critical decisions across the organization.
As a Senior Data Engineer, you’ll play a key role in their dynamic data team, focusing on building a new healthcare data ecosystem. Your expertise in designing, implementing, and optimizing data solutions will support their migration to Azure and facilitate high-quality data operations. You’ll be responsible for complex data structures, data modeling, and analysis, ensuring data is accessible, accurate, and efficient for both technical and non-technical stakeholders.
Responsibilities
* Lead the design and implementation of data pipelines and architectures in Databricks and Azure Data Factory.
* Develop robust data processing solutions in Python and PySpark, ensuring high efficiency and reliability.
* Use expert knowledge to design and develop ETL pipelines and cloud data storage solutions that meet business requirements, while also taking into consideration non-functional needs.
* Work closely with stakeholders across technical and non-technical backgrounds to understand data needs and provide optimal solutions.
* Ensure data integrity, quality, and accessibility across the new Azure-based healthcare ecosystem.
* Contribute to data modeling, data analysis, and migration strategies, with a focus on creating sustainable and scalable solutions.
* Collaborate with the wider data team to establish best practices in data structure, pipeline optimization, and performance tuning.
Requirements
* 6+ years in data engineering with a strong focus on cloud data migration projects:
* Proficiency with Databricks and Azure Data Factory.
* Advanced knowledge of Python and PySpark.
* Strong command of SQL for data transformation, cleaning, and manipulation
* Experience working in CI/CD, DevOps and agile delivery environments
* In-depth understanding of data structures and data architectures.
* Solid experience in data modeling and data analysis.
* Strong collaboration skills, with the ability to engage and influence both technical and non-technical stakeholders effectively.
If this sounds like the role for you hit APPLY & a consultant will be in touch
Reference: 222569307
Alert me to jobs like this:
Amplify your job search:
Expert career advice
Increase interview chances with our downloads and specialist services.
Visit Blog