Senior Azure Data Engineer
Posted on Sep 15, 2020 by Orcan Intelligence
For our prestigious customer, we are currently searching for a Senior Data Engineer w/Azure experience for an exciting 10-month project (with visibility to extend) in Belgium!
In this project you will be implementing data pipelines within the Big Data Platform, particularly using your experience with Azure and Spark.
- Experience in workflow management and job scheduling of data loads with airflow, and azure data factory.
- Experience in Real Time data streaming and processing is a plus (azure functions/event hubs/streaming analytics)
- Experience with the Azure cloud and the Azure Data Analytics stack.
- Knowledge of ETL for large data sets on distributed systems
- Strong Python programming experience
- Experience with data exploration: Jupyter notebooks, dashboarding
- Experience with ETLs with aggregations, deduplication and linking to identities
- Experience in build automation and devops, CI/CD tooling
- Experience with web environments using big data Intel/recommendations. Javascipt, Java, Node Js, API layer to expose data
- Have experience working with Data Scientists to implement pipelines for them to work on.
If you have the required skills and interested to apply, please send your CV now for immediate consideration.