This Job Vacancy has Expired!

Senior Data Engineer

Salt

Posted on Apr 26, 2021 by Salt

Brussel, Belgium
IT
Immediate Start
Daily Salary
Contract/Project


Senior Data Engineer required for a leading client in Brussels, Belgium, for an initial 1-year contract


Senior Data Engineer required with design skills whose core objectives will be to collect, clean, prepare and load the necessary data onto Hadoop, our clients Data Analytics Platform, so that these can be used for reporting purposes; creating insights, responding to business challenges. You will also act as a liaison between the team and other stakeholders and contribute to support the Hadoop cluster and the compatibility of all the different software that runs on the platform (Scala, Spark, Python,etc).


Required skills:



  • Experience with analysis and creation of data pipelines, data architecture, ETL/ELT development and processing structured and unstructured data

  • Proven experience with using data stored in RDBMSs and experience or good understanding of NoSQL databases

  • Ability to write performant Scala code and SQL statements

  • Ability to design with focus on solutions that are fit for purpose whilst keeping options open for future needs

  • Ability to analyze data, identify issues (eg gaps, inconsistencies) and troubleshoot these

  • Knowledge of Python and Spark

  • Knowledge of Python and Spark

  • Understanding of the Hadoop ecosystem including Hadoop file formats like Parquet and ORC

  • Experience with open source technologies used in Data Analytics like Spark, Pig, Hive, HBase, Kafka, etc.


This position will be remotely based until at least December, if not, for the whole duration of the contract




Reference: 1179559960

Set up alerts to get notified of new vacancies.