This Job Vacancy has Expired!

Data Engineer: Machine Vision: Azure/AWS

Eaglecliff Recruitment

Posted on Apr 24, 2021 by Eaglecliff Recruitment

Rotterdam, Zuid-Holland, Netherlands
10 May 2021
Daily Salary

A World Leading Global Energy Company has an exciting contract opportunity for a Data Engineer to join a part of the business that drives digital innovation opportunities and delivers new capabilities, creating, deploying and supporting cutting-edge IT solutions.

About the Role:

The Data Engineering team is accountable to develop, deploy and sustain leading edge marketing and advanced analytics platform capabilities for the business, providing a truly leading edge capability which delivers sustainable competitive advantage and business value..

As a Data Engineer, you will work alongside the Data Science Lead and will be responsible to support the development of cutting edge algorithms using the latest big data and machine learning technology. You will ingest structured, semi-structured and unstructured batch- and Real Time data from numerous data sources into the newly yet to be designed data platform. As a Data Engineer, you will use the latest auto deployment, testing and monitoring techniques and work closely with the Solution Architect and Data Architect to design the big data platform.

Purpose and Accountabilities:

- Work together with the Solution and Data Architect to design the next generation big data platform to support the digital marketing platform
- Design and implement a new big data solution which supports high amounts- and velocity of data, supports future growth, use latest big data technologies/techniques, is cloud supported and in-line with the businesses strategies
- Design and implement modern data pipelines to extract, clean and process data in batch and Real Time from different data sources
- Use the latest development, testing and deployment techniques to quickly deploy new releases to eg deploy new data pipelines and add data sources

Skills & Requirements:
- Bachelor or master degree in information technology, computer science, data management business administration or a related discipline

Preferred Experience:
- 5+ years' experience with big data platforms; working with large data sets, large amounts of data in motion and numerous big data technologies
- Preferable experience with data science scenarios and machine learning frameworks (Caffe, Theano, Tensorflow, MXnet, CNTK)
- Knowledge in Machine Vision will be advantageous
- Auto software deployment technologies (eg Jenkins, Docker, Git)
- Experience with Cloud (AWS, Microsoft Azure)
- Hadoop/Spark-based technologies (eg Spark, MapReduce, Hive and Pig)
- NoSQL-based technologies (eg Cassandra, HBASE, MongoDB)
- Awareness of Agile Framework and its tools such as Visual Studio Team Services (VSTS)
- Data pipelining-based technologies (eg KAFKA, StreamSets, Flume Talend, ADFv2)

Core Experiences:
- Highly analytical, troubleshooting and problem-solving skills
- Experience with data Architecture and design techniques (local/abstract)
- Experience with API techniques/developments
- Experience with data transformation/blending technology (eg Alteryx is preferred)
- Experience with Spark based

- SQL-based technologies (eg MSSQL, MySQL, PostgreSQL)
- Source Code Control (eg Git, Subversion)
- Open Source Frameworks (Apache Spark, Hadoop etc.)
- Agile Project Delivery techniques (eg SCRUM)
- Strong design and coding skills (eg Python, Scala, JavaScript)

Reference: 1177529625

Set up alerts to get notified of new vacancies.