Senior Lead Data Engineer Urgently Required
Posted on Oct 7, 2020 by Gazelle Global Consulting
Senior Lead Data Engineer
One of my globally leading clients is urgently looking for a Senior Data Engineer to translates business demand in solution designs, leveraging the big data design patterns and architectural guiderails. The Senior lead data engineers aligns identifies dependencies and overlap with other business demand and ensures that the team executes according to business requirements.
The ideal Senior Lead Data Engineer will have the following responsibilities:
- The lead Data engineers manages stakeholders by aligning on solution design challenges and choices made to address the business requirements.
- You collaborate with solution architects, competence, development team and business to ensure consistency in the overall big-data landscape.
- During the development of solutions, the Sr. data engineers leads their team so that it adhering to the architectural guidance and that deviations are understood and accepted.
The ideal Senior Lead Data Engineer will have the following skills:
SQL background, understanding the concepts of OLAP/BI querying patterns, and has paratactical knowledge in creating these solutions to support this.
Datamodelling experience, preferably on non-business process data domains (eg IOT, machine data)
5+ years (hands-on) experience with designing and building robust solutions for storing very large quantities of raw data of different sizes in the proper technology solution (eg. Hbase, HDFS, Object Storage & Oracle)
2+ years (hands-on) experience in designing and building both batch and streaming architectures based on SPARK (we have moved on from Spark?)
2+ years (hands-on) experience with columnar storage formats, and backends (Kudu, Parquet, ORC)
Experienced integrating SQL engines into solutions (eg Impala, Drill)
2+ years (hands-on) experience with big data (hybrid) cloud concepts and implementations
Please get in touch ASP for further details:
Contract duration: 6 months