Data Engineer Cask Data Application Platform & JAVA

Simon James I.T. Ltd

Posted on Jul 5, 2024 by Simon James I.T. Ltd
London, United Kingdom
IT
24 Aug 0001
£700 - £800 Daily
Contract/Project

Data Engineer Cask Data Application Platform & JAVA

Hybrid London - Fintech

The role:

We are looking for 2 talented Software Engineer to build and optimize the data platforms of a leading Fintech organisation. You'll need a strong data engineering background, having worked with AWS tools like S3, EMR, EC2, and a strong level of SQL ability including commercial experience with Spark, Kafka and CDAP. You'll use this skill set to design and implement robust and scalable data pipelines, ETL, and analytics systems.

As part of the wider Data Engineering team, this role will have a specific focus on plug-in enhancement/development, so we are looking for someone with strong current Java expertise.

Role Responsibilities:

  • Develop and enhance data pipelines, ETL processes using CDAP on AWS infrastructure.
  • Build data integration flows to migrate large datasets into Snowflake data warehouse.
  • Implement IaC solutions for deployment automation.
  • Work with data scientists to optimize data workflows and models on Databricks
  • Participate in architecture reviews and technology selections

Requirements:

  • CDAP, Spark, Kafka
  • Java and unit testing
  • Experience building scalable ETL processes and workflows
  • Strong Python
  • AWS - S3, EC2, EMR, SQL
  • Infrastructure-as-code expertise with CI/CD pipelines

You'll need all of the above, clearly shown in your CV to be shortlisted

This is a great opportunity to join an organisation moving into to a period of well planned growth and a development. Very forward thinking, technology focussed environment with huge advances in the ML and AI space in progress.

This role would suit someone with a strong data engineering background that has worked on large scale cloud based data and wants to join a project as the JAVA Subject Matter Expert of a larger Data team


Reference: 2789046804

https://jobs.careeraddict.com/post/92746459

This Job Vacancy has Expired!

Simon James I.T. Ltd

Data Engineer Cask Data Application Platform & JAVA

Simon James I.T. Ltd

Posted on Jul 5, 2024 by Simon James I.T. Ltd

London, United Kingdom
IT
24 Aug 0001
£700 - £800 Daily
Contract/Project

Data Engineer Cask Data Application Platform & JAVA

Hybrid London - Fintech

The role:

We are looking for 2 talented Software Engineer to build and optimize the data platforms of a leading Fintech organisation. You'll need a strong data engineering background, having worked with AWS tools like S3, EMR, EC2, and a strong level of SQL ability including commercial experience with Spark, Kafka and CDAP. You'll use this skill set to design and implement robust and scalable data pipelines, ETL, and analytics systems.

As part of the wider Data Engineering team, this role will have a specific focus on plug-in enhancement/development, so we are looking for someone with strong current Java expertise.

Role Responsibilities:

  • Develop and enhance data pipelines, ETL processes using CDAP on AWS infrastructure.
  • Build data integration flows to migrate large datasets into Snowflake data warehouse.
  • Implement IaC solutions for deployment automation.
  • Work with data scientists to optimize data workflows and models on Databricks
  • Participate in architecture reviews and technology selections

Requirements:

  • CDAP, Spark, Kafka
  • Java and unit testing
  • Experience building scalable ETL processes and workflows
  • Strong Python
  • AWS - S3, EC2, EMR, SQL
  • Infrastructure-as-code expertise with CI/CD pipelines

You'll need all of the above, clearly shown in your CV to be shortlisted

This is a great opportunity to join an organisation moving into to a period of well planned growth and a development. Very forward thinking, technology focussed environment with huge advances in the ML and AI space in progress.

This role would suit someone with a strong data engineering background that has worked on large scale cloud based data and wants to join a project as the JAVA Subject Matter Expert of a larger Data team

Reference: 2789046804

CareerAddict

Alert me to jobs like this:

Amplify your job search:

CV/résumé help

Increase interview chances with our downloads and specialist services.

CV Help

Expert career advice

Increase interview chances with our downloads and specialist services.

Visit Blog

Job compatibility

Increase interview chances with our downloads and specialist services.

Start Test