Data Platform Engineer

CV-Library

Posted on Jan 8, 2025 by CV-Library
City of London, City and County of the City of London, United Kingdom
IT
Immediate Start
£70k - £84k Annual
Full-Time
About the Role

My client is seeking a skilled and experienced Data Warehouse Engineer to maintain and optimise data warehouse infrastructure, develop robust ETL processes, and ensure data quality across the organisation. You will collaborate with business and technology stakeholders to design scalable, automated data pipelines and support AI/ML model infrastructure. This is an exciting opportunity to work in a purpose-led sector, leveraging advanced technologies to create meaningful impact.

Key Responsibilities

Maintain and optimise the organisation's data warehouse infrastructure.
Design, implement, and document ETL/ELT procedures for data intake, adhering to industry standards.
Verify data quality and ensure it meets business requirements.
Monitor, tune, and analyse database performance to ensure reliability and scalability.
Collaborate with stakeholders to design data marts, meta data, and models in partnership with Power BI Engineers.
Maintain all data warehouse architecture codes in AzureDevOps.
Automate tasks and deploy production-standard code with unit testing, continuous integration, and versioning.
Optimise and configure systems to improve reliability, performance, and functionality.
Support and improve AI/ML model infrastructure to meet evolving business needs.
Troubleshoot data-related issues and manage system access for stakeholders.
Deliver high-quality solutions within set timelines and budgets, ensuring customer satisfaction.

Technical Skills & Experience

Bachelor's degree in an analytic field such as information technology, science, or engineering.
5+ years of experience in data warehouse architecture development and management.
Proficiency in Azure Data Factory, Azure Blob Storage, Azure Databricks, and AzureDevOps.
Extensive knowledge of ETL/ELT processes, including pipelines for AI/ML models.
Expertise in performance tuning, optimisation, and governance of Databricks platforms.
Strong experience with dimensional modelling techniques.
Ability to manage end-to-end data platforms, from ingestion to presentation layers.
Proficiency in SQL, Python, and Spark.
Experience with Unity Catalog and data security/privacy measures.
Knowledge of big data tools (e.g., Google Maps API, Apify) and machine learning fundamentals.
Hands-on experience with AI/ML model development, deployment, and performance monitoring.
Ability to explain AI model outcomes and metrics to non-technical stakeholders.

Soft Skills & Attributes

Strong analytic and consultative skills.
Excellent communication and interpersonal abilities to collaborate across diverse teams.
Results-oriented mindset with a focus on delivering against KPIs.
Exceptional time management and multitasking abilities.
Passion for working in a purpose-driven sector.
Fluent in English.

Benefits

💷 Salary: £84,000 per year.
🌴 Holidays: Generous annual leave.
🏦 Pension Scheme: Comprehensive and competitive.
🛍️ Retail Discounts: Access to exclusive discounts on a variety of brands

Reference: 222873559

https://jobs.careeraddict.com/post/98697496

This Job Vacancy has Expired!

CV-Library

Data Platform Engineer

CV-Library

Posted on Jan 8, 2025 by CV-Library

City of London, City and County of the City of London, United Kingdom
IT
Immediate Start
£70k - £84k Annual
Full-Time
About the Role

My client is seeking a skilled and experienced Data Warehouse Engineer to maintain and optimise data warehouse infrastructure, develop robust ETL processes, and ensure data quality across the organisation. You will collaborate with business and technology stakeholders to design scalable, automated data pipelines and support AI/ML model infrastructure. This is an exciting opportunity to work in a purpose-led sector, leveraging advanced technologies to create meaningful impact.

Key Responsibilities

Maintain and optimise the organisation's data warehouse infrastructure.
Design, implement, and document ETL/ELT procedures for data intake, adhering to industry standards.
Verify data quality and ensure it meets business requirements.
Monitor, tune, and analyse database performance to ensure reliability and scalability.
Collaborate with stakeholders to design data marts, meta data, and models in partnership with Power BI Engineers.
Maintain all data warehouse architecture codes in AzureDevOps.
Automate tasks and deploy production-standard code with unit testing, continuous integration, and versioning.
Optimise and configure systems to improve reliability, performance, and functionality.
Support and improve AI/ML model infrastructure to meet evolving business needs.
Troubleshoot data-related issues and manage system access for stakeholders.
Deliver high-quality solutions within set timelines and budgets, ensuring customer satisfaction.

Technical Skills & Experience

Bachelor's degree in an analytic field such as information technology, science, or engineering.
5+ years of experience in data warehouse architecture development and management.
Proficiency in Azure Data Factory, Azure Blob Storage, Azure Databricks, and AzureDevOps.
Extensive knowledge of ETL/ELT processes, including pipelines for AI/ML models.
Expertise in performance tuning, optimisation, and governance of Databricks platforms.
Strong experience with dimensional modelling techniques.
Ability to manage end-to-end data platforms, from ingestion to presentation layers.
Proficiency in SQL, Python, and Spark.
Experience with Unity Catalog and data security/privacy measures.
Knowledge of big data tools (e.g., Google Maps API, Apify) and machine learning fundamentals.
Hands-on experience with AI/ML model development, deployment, and performance monitoring.
Ability to explain AI model outcomes and metrics to non-technical stakeholders.

Soft Skills & Attributes

Strong analytic and consultative skills.
Excellent communication and interpersonal abilities to collaborate across diverse teams.
Results-oriented mindset with a focus on delivering against KPIs.
Exceptional time management and multitasking abilities.
Passion for working in a purpose-driven sector.
Fluent in English.

Benefits

💷 Salary: £84,000 per year.
🌴 Holidays: Generous annual leave.
🏦 Pension Scheme: Comprehensive and competitive.
🛍️ Retail Discounts: Access to exclusive discounts on a variety of brands

Reference: 222873559

CareerAddict

Alert me to jobs like this:

Amplify your job search:

CV/résumé help

Increase interview chances with our downloads and specialist services.

CV Help

Expert career advice

Increase interview chances with our downloads and specialist services.

Visit Blog

Job compatibility

Increase interview chances with our downloads and specialist services.

Start Test

Similar Jobs

Senior Quantity Surveyor

Castle Baynard, City and County of the City of London, United Kingdom

Contracts Manager (Decent Homes)

City of London, City and County of the City of London, United Kingdom

Consultant Psychiatrist

City of London, City and County of the City of London, United Kingdom

Trainee Recruitment Consultant

City of London, City and County of the City of London, United Kingdom