Data Engineer

Outsource UK

Posted on Sep 23, 2022 by Outsource UK

Sussex, United Kingdom
IT
Immediate Start
£27k - £35k Annual
Full-Time

Data, Hadoop, Spark, Kafka, SQL, Python, Java, Scala, Azure

Our client based in Sussex are expanding and optimising their data and data pipeline architecture, as well as optimising the data flow, data quality and data collection for cross functional teams.

About the role:

  • You create, test monitor, and maintain data pipelines from multiple applications to the Azure Data Factory.
  • Ensure infrastructure meets the requirements for optimal extraction, transformation and loading of data from a wide variety of sources.
  • Ability to seek out opportunities to automate routine or manual tasks, using Scripting languages, software frameworks and libraries to move, translate and store data.
  • Ability to use analysis tools to explore the data, link data from diverse sources, and provide context that helps the understanding of others.

Experience and knowledge:

  • Good working SQL knowledge and experience working with relational databases.
  • Data pipeline and workflow management tools.
  • Experience with Hadoop, Spark, Kafka, etc.
  • Experience with relational SQl and NoSQL databases.
  • Experience with object-oriented/object function Scripting languages: Python, Java, C++, Scala, etc.
  • Experience with Azure Data Factory.

Full Specification available. Please apply if you feel you have the necessary skills, you will be contacted by Nadia Ahmed from Outsource UK.

Data, Hadoop, Spark, Kafka, SQL, Python, Java, Scala, Azure

Reference: 1738306774

Set up alerts to get notified of new vacancies.

Similar Jobs

Data Engineer

Brighton, East Sussex, United Kingdom

£45k - £55k Annual

Data Engineer

Horsham, West Sussex, United Kingdom

£55k - £65k Annual

Data Engineer

Reading, Berkshire, United Kingdom

Annual Salary

Data Engineer

Glasgow, Lanarkshire, United Kingdom

Annual Salary