Lead Data Engineer

Posted on Sep 21, 2022 by MLR Associates

York, Yorkshire, United Kingdom
Immediate Start
Annual Salary
  • Global Leading Technology Brand
  • Working from home option, WFH with periodic site visits
  • Attractive Salary & Benefits Package
  • Latest Cutting Edge Technology
  • £90,000-£95,000 + shares + bonus & benefits

Our client a global technology leader is currently looking for a Lead Data Engineer.

The successful candidate will help architect and build new data solutions and initial PoCs using SaaS and PaaS-based services on Azure. While Microsoft PaaS data services are often the starting point, knowledge and experience of non-Microsoft PaaS services is welcomed and encouraged, including hosted services on other Cloud providers. The ability to critique and assess whole-of-industry options (both functionally and non-functionally) and communicate options is imperative.

The role requires someone with a strong understanding of how to set up the appropriate tools and technologies in the cloud to securely process big and small, unstructured and structured data - from ingestion, cleansing, transformation, enrichment, outlier/anomaly detection, auto matching/classification and finally to the delivery of accurate data for insights, analysis and reporting.

Knowing how to deploy fast R&D solutions and robust operational/production systems is key and having previous experience of implementing secure, scalable and automated data pipelines and self-service Business Intelligence solutions is a must.

We need someone who can get stuff done and deliver value incrementally to the business - who completely understands what agility really is and always looks to keep things simple, understands best practices in the cloud, the importance of DevOps and ensures that we can easily build, deploy and monitor our solutions when they go into production - keeping an eye on infrastructure costs.

Required skills:

  • Passion for and experience of building data analytical platforms to deliver business value.
  • Ability to setup secure, automated and scalable data platforms/technologies within Microsoft Azure.
  • Good awareness of data services available across the market with an ability to rationally compare and communicate options, considering both functional and non-functional factors.
  • Good working knowledge of various database types and when to use them, ie SQL, Columnar, Graph, Key-Value, and Document.
  • Solid experience working with ELT/ETL tools like Data Factory, Matillion and SSIS.
  • Solid experience working with Azure Storage and Azure Data Lake.
  • Good understanding of different types of data (ie structured, semi-structured and unstructured data) and the considerations that should be made in how they are stored.
  • Solid experience of working with and implementing BI solutions on platforms like Tableau and Power BI.
  • Solid understanding on how to incorporate data lineage, discovery and governance within production solutions, with experience in tools such as Purview, Informatica, or Apache Atlas.
  • Solid experience of data management and validation techniques.
  • Excellent knowledge of database design patterns - including OLTP, OLAP and overall schema design
  • Solid experience of traditional data warehousing (Kimball/Inmon) and modern warehousing techniques and services (eg Synapse Analytics, Snowflake).
  • Excellent working knowledge of T-SQL.
  • Excellent attention to detail and accuracy is a must.
  • Excellent troubleshooting skills and the ability to quickly identify the source of any data errors or performance issues and solve these.
  • Experience of ensuring data is properly backed up, resilient, and understand the importance of backup testing.

Reference: 1735724827

Set up alerts to get notified of new vacancies.

Similar Jobs

Data Engineering Lead/Manager - Leeds/Remote

Leeds, West Yorkshire, United Kingdom

£500 - £600 Daily

Lead Data Engineer

London, United Kingdom

£90k - £130k Annual

Lead Data Engineer

Manchester, Greater Manchester, United Kingdom

£55k - £60k Annual

Lead Data Engineer

Reading, Berkshire, United Kingdom

Annual Salary