Senior Data Engineer

Senior Data Engineer - £45-86k - UK Remote Working - Must have SC Clearance

Our client, a leading consultancy business is looking for outstanding talent to join their vibrant and growing team. With cutting-edge resources, are you the next hire to join their passionate team.

Main responsibilities of the Senior Data Engineer:

As a Senior Data Engineer, you will be accountable or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working within a multi-skilled agile team, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems, while designing and developing large-scale data processing software to meet user needs in demanding production environments.

• Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software life cycle including design, code, test and defect resolution.
• Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality.
• Working with Architects and Lead Engineers to ensure the software supports non-functional needs.
• Working with operations teams to ensure operational readiness
• Advising customers and managers on the estimated effort and technical implications of user stories and user journeys.
• Coaching and mentoring team members.

Essential Requirements for the Senior Data Engineer:

• Strong software development experience in one of Java, Scala, or Python
• Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.
• Solid understanding of ETL/ELT data processing pipelines and design patterns
• Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment
• Proficient in SQL and SQL extensions for analytical queries
• Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats
• Able to write quality, testable code and has experience of automated testing
• Experience with Continuous Integration and Continuous Deployment techniques

Desirables for the Senior Data Engineer:

• Experience of performance tuning
• Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products
• Experience of data visualisation and complex data transformations
• Expertise in continuous improvement and sharing input on data best practice

Job title: Senior Data Engineer

Job type: Permanent

Job Location: Remote

Job Salary: £45-86k per annum + Benefits