This Job Vacancy has Expired!

Senior Data Engineer

Posted on Apr 24, 2021 by Base 3

Brussel, Belgium
IT
Immediate Start
Annual Salary
Contract/Project


Main objectives of this role:

  • Collect, clean, prepare and load the necessary data onto Hadoop, our Data Analytics Platform, so that these can be used for reporting purposes; creating insights and responding to business challenges
  • Act as a liaison between the team and other stakeholders and contribute to support the Hadoop cluster and the compatibility of all the different software that run on the platform (Scala, Spark, Python, ).

Required skills:

  • Experience with analysis and creation of data pipelines, data architecture, ETL/ELT development and with processing structured and unstructured data
  • Proven experience with using data stored in RDBMSs and experience or good understanding of NoSQL databases
  • Ability to write performant Scala code and SQL statements
  • Ability to design with focus on solutions that are fit for purpose whilst keeping options open for future needs
  • Ability to analyze data, identify issues (eg gaps, inconsistencies) and troubleshoot these
  • Have a true agile mindset, capable and willing to take on tasks outside of her/his core competencies to help the

Will be considered as assets:

  • Knowledge of Python and Spark
  • Understanding of the Hadoop ecosystem including Hadoop file formats like Parquet and ORC
  • Experience with open source technologies used in Data Analytics like Spark, Pig, Hive, HBase, Kafka,
  • Ability to write MapReduce & Spark jobs
  • Knowledge of Cloudera
  • Knowledge of IBM Mainframe
  • Knowledge of AGILE development methods such as SCRUM is clearly an asset.



Reference: 1177529807

Set up alerts to get notified of new vacancies.