Data Engineer - London - 55k

My Client currently have an exciting opportunity available for a Data Engineer to join their Data Engineering team based in London. This is a fantastic opportunity for an experienced data engineer to support the ETL, data pipelines, core databases and strategic projects.

The successful candidate will be responsible for building entirely new data products and maintaining/iterating on our existing datasets, data pipelines and tools in use daily at My Client by the Data and Research teams.

If you feel the below is a good match with your skills and experience please don't hesitate to reply:

Duties

• Build/maintain data pipelines using Python
• Build/extend/transform core datasets inside a SQL data warehouse
• Design and implement new data solutions for use by internal teams and external clients
• Support a range of strategic, company-level data initiatives

Requirements

• 4+ years experience as a Data Engineer
• Our tech stack is predominantly:
• Python: Anaconda, pandas, SQLAlchemy, web scraping libraries
• SQL: PostgreSQL
• Cloud: GCP, AWS
• DevOps: Docker, Doppler
• Orchestration: Airflow
• Data visualization + apps: Plotly, dash, Flask, Retool
• Experience building reliable, maintainable data pipelines
• Experience with web scraping
• Experience with scheduling/orchestration tools
• Strong understanding of how to build, extend, query SQL databases - natively and via Python
• Understanding of how to best organize and model data for storage, retrieval, and analysis
• Best practice in data development: documentation, version control, testing and automation
• Understanding of the importance of data governance and metadata
• A methodical, analytical, and organised approach to tackling large scale projects and data sets
• Effective communication skills, comfortable presenting to technical and non-technical audiences

Data Engineer - London - 55k