This Job Vacancy has Expired!

Lead Data Engineer - Big Data, London, Flexible working

BlackCode

Posted on Nov 4, 2021 by BlackCode

London, United Kingdom
IT
Immediate Start
£100k - £160k Annual
Full-Time

Greenfield, newly formed UK Data Engineering Practice for a Global leading brand who seeks the help of a Lead Data Engineer.

Delivering a centralized data warehouse that enables engineers and analysts across the company to ingest, anonymize, and enrich with other data sources from anywhere else in the company, and to persist, analyse, purge, and otherwise process their data.

Building Data applications that don't fall into any one business unit, or where the business units don't have sufficient capabilities themselves. For example, working with the Data Insights team to build and operate churn-prediction models used by both humans and other systems at scale.

Responsibilities will include:

  • Understand the need of your internal customers and convert them to optimized and maintainable tech designs.
  • Use your data engineering skills to design and build the ingestion, processing, storage, and consumption system for data to enable other business units to make business and operational decisions using data.
  • Maintain and operate the data platform which many business units rely on to fulfil their service level targets.

Team notes:

  • Tech stack currently mostly focuses on AWS Redshift, Google BigQuery, Apache Airflow and Tableau, but it will evolve significantly.
  • An ever-expanding range of engineering roles on the team, covering people with backgrounds in software development, infrastructure operations, and data science.

Role Requirements

  • Proficiency in Python and SQL, with a good understanding in runtime complexities
  • Experience in building and running applications in cloud environments (AWS, Azure, or GCP)
  • Knowledge in large scale batch/stream processing frameworks such as Apache Spark/Flink/Storm is a big plus

Please make contact for full details and thank you for your consideration.

Reference: 1390240693

Set up alerts to get notified of new vacancies.