This Job Vacancy has Expired!

Senior Data Engineer - ETL

Skillbase Group Ltd

Posted on Aug 19, 2021 by Skillbase Group Ltd

Brussel, Belgium
IT
Immediate Start
Annual Salary
Contract/Project


Senior Data Engineer - ETL

( Scala, Apache Flink, Apache Kafka, Spark, Python )

Are you an experienced Data Engineer looking for long term mission? Do you have experience of creating data pipelines, data architecture, ETL/ELT development and with processing structured and unstructured data? Then we have the contract for you!

One of our prestigious clients in the financial sector are hiring a Data Engineer with design skills. You will join a data analytics team that helps to transform data into insights using techniques such as text mining, machine learning, process mining, network analytics, predictive modelling,
You role in this team will be to collect, clean, prepare and load the necessary data onto Hadoop, our Data Analytics Platform, so that these can be used for reporting purposes; creating insights and responding to business challenges, you will act as a liaison between the team and other stakeholders and contribute to support the Hadoop cluster and the compatibility of all the different software that run on the platform (Scala, Spark, Python ).

Skills:

  • Experience with analysis and creation of data pipelines, data architecture, ETL/ELT development and with processing structured and unstructured data
  • Proven experience with using data stored in RDBMSs and experience or good understanding of NoSQL databases
  • Ability to write performant Scala code and SQL statements
  • Ability to analyse data, identify issues (eg gaps, inconsistencies) and troubleshoot these

Desired skills:

  • Apache Flink, Apache Kafka
  • Knowledge of Python and Spark
  • Understanding of the Hadoop ecosystem including Hadoop file formats like Parquet and ORC
  • Experience with open source technologies used in Data Analytics like Spark, Pig, Hive, HBase, Kafka,
  • Ability to write MapReduce & Spark jobs
  • Knowledge of Cloudera
  • Knowledge of IBM Mainframe
  • Knowledge of AGILE development methods such as SCRUM is clearly an asset.

Please send your CV or call us today for more information.

Not for you? But might know someone, we pay referral fees....

( Scala, Apache Flink, Apache Kafka, Spark, Python )




Reference: 1292082785

Set up alerts to get notified of new vacancies.