Data Engineer

Savant Recruitment

Posted on Feb 2, 2024 by Savant Recruitment
Milton Keynes, Buckinghamshire, United Kingdom
IT
Immediate Start
Annual Salary
Contract/Project

Our client is looking for a Data Engineer with AWS experience who will play a crucial role in the design, development, and maintenance of data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives.

Key Responsibilities:

  • Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion.
  • AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions.
  • Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance.
  • Data Quality: Implement data quality and data governance best practices to maintain data integrity.
  • Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
  • Documentation: Create and maintain comprehensive documentation for data pipelines, architecture, and best practices.
  • Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions.
  • Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions.

Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python,

Good to have: Cloudera - Spark, Hive, Impala, HDFS, Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin


Reference: 2710578108

https://jobs.careeraddict.com/post/87726354

This Job Vacancy has Expired!

Savant Recruitment

Data Engineer

Savant Recruitment

Posted on Feb 2, 2024 by Savant Recruitment

Milton Keynes, Buckinghamshire, United Kingdom
IT
Immediate Start
Annual Salary
Contract/Project

Our client is looking for a Data Engineer with AWS experience who will play a crucial role in the design, development, and maintenance of data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives.

Key Responsibilities:

  • Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion.
  • AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions.
  • Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance.
  • Data Quality: Implement data quality and data governance best practices to maintain data integrity.
  • Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
  • Documentation: Create and maintain comprehensive documentation for data pipelines, architecture, and best practices.
  • Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions.
  • Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions.

Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python,

Good to have: Cloudera - Spark, Hive, Impala, HDFS, Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin

Reference: 2710578108

CareerAddict

Alert me to jobs like this:

Amplify your job search:

CV/résumé help

Increase interview chances with our downloads and specialist services.

CV Help

Expert career advice

Increase interview chances with our downloads and specialist services.

Visit Blog

Job compatibility

Increase interview chances with our downloads and specialist services.

Start Test

Similar Jobs

Senior Data Engineering Consultant - Remote - £75,000 + bonus

Milton Keynes, Buckinghamshire, United Kingdom

Data Engineer

Willen, Buckinghamshire, United Kingdom

Data Engineers

Hampshire, United Kingdom

Data Engineer

Cheshire, United Kingdom