This Job Vacancy has Expired!

AWS Data Engineer - Dutch Speaker - Freelance/Contract - Brussels

Robson Bale Ltd

Posted on Nov 6, 2020 by Robson Bale Ltd

Brussel, Belgium
IT
1 Nov 2020
Annual Salary
Contract/Project


AWS Data Engineer - Dutch Speaker - Freelance/Contract - Brussels

Robson Bale are looking for a Dutch Speaking AWS Data Engineer for an initial 12 month contract in Brussels.

12 months, market rate

Candidates MUST speaker Dutch for this role

Project description

Our client is looking for an AWS Data Engineer (SR) for the development process of Terra and the Energy Performance Platform.

In collaboration with HFB and VEA, our client offers an application that collects data from all buildings and infrastructure used by the public sector in Flanders.

Research shows that mere insight into energy consumption can already lead to a 3% decrease. TERRA therefore primarily wants to present to organizations and support services a report of the evolution consumption and to offer tools for benchmarking.

But more effort is needed to achieve the climate targets. TERRA is therefore growing into a central policy-supporting platform that visualises savings measures, subsidies and funds, monitoring tools and the 2030 goals. Energetic master plans and OEPC processes are facilitated in this way.

TERRA is crucial to our client's objective to unburden the public sector and to guarantee the efficient use of investment resources.

Finally, TERRA must also become an open data portal for energy-related data. In accordance with the objectives of the Flemish government, semantic and organized standards are provided that enable reuse of data by internal and external parties.

The Terra platform is set up on Amazon Web Services and uses various PAAS and IAAS solutions. The data lake/data warehouse that is used for all kinds of reporting and analysis purposes uses the following Amazon Web services:

Data pipelines and EMR for loading and processing data.

S3 for storing files

Amazon Redshift (DWH)

Tableau as a reporting environment

Athena for querying flat files in the data lake

SQL server as Back End database of the Terra web application

Lambda for running Back End services

DMS for synchronization of data including from SQL server to redshift

For example, for processing the consumption data that is supplied on a daily basis, Python and Spark is used as an ETL process to merge the new consumption data in the Redshift DWH with existing data.

In addition, links are made with numerous other data sources to enrich the data warehouse.

GIT is used to version control the code and the release process (dev, stg, prod) uses MS Devops. The latter is also used for following up sprints, user stories, tasks, ...

Main responsibilities :

You manage the existing stack of data flows and pipelines in the AWS cloud environment that uses, among others, S3, EMR, Spark, Redshift, Lambda, Python.

You will develop (further) complex data models to generate further analytical insight

You write high-quality code to further develop the data platform. The platform is scalable and easy to maintain.

You will link/integrate new data sources from various origins into the existing solution.

You analyze existing processes and advise where performance gains and cost savings can be achieved.

You implement data quality controls and alert stakeholders so that the necessary actions can be taken.

All projects within the client are developed according to the Agile SCRUM methodology. As a data engineer you work closely with the other members of the multidisciplinary team.

You report to the project manager of the team.

Technical skills

Experience with AWS

Experience with Spark

Experience in Python

Experience with Data pipelines

Experience with SQL Server

Experience with GIT

Experience with Redshift

Experience with DMS

Experience with EMR

You have a valid and relevant AWS certification

You closely follow technological developments (and more specifically within AWS) and you can distinguish hype from value

General skills (behavioural competences)

Experience with Agile methodologies (Agile Scrum)

Independent, result-oriented, reliable

Attention to detail

Proactive

Communicative

Team player

Analytical, critical and thinks out of the box

12 months, market rate

Candidates MUST speaker Dutch for this role

AWS Data Engineer - Dutch Speaker - Freelance/Contract - Brussels




Reference: 996375901

Set up alerts to get notified of new vacancies.