This Job Vacancy has Expired!

Azure Data Engineer: Python: Global Energy Trading Co

Eaglecliff Recruitment

Posted on Jan 6, 2023 by Eaglecliff Recruitment

London, United Kingdom
IT
Immediate Start
Annual Salary
Contract/Project
Exciting opportunity for an experienced Azure Data Engineer to join this global Energy company, to be a part of their Energy Trading team, who has a focus on the delivery of complex data management solutions by leveraging industry best practices.

You will have the opportunity to work across a green field implementation of data analytics solutions, delivering high value to the customer.

This is an exciting time to be joining this world-leading company as they transform themselves from a traditional Oil & Gas company into a leading name within the Renewables sector. This includes the creation of an already highly successful new Power Trading desk within the Energy Trading team as well as new ventures into various innovative solutions around the supply of Renewables including wind farms, electric vehicle charging, solar panel heating and battery storage. These innovative solutions provide opportunities for exceptionally highly talented individuals to contribute to the success of this transition where you will be working with some of the best people in the industry working on new and ground-breaking initiatives utilising the very latest technology.

About The Role:

- Build the most efficient data pipelines and data management solutions
- Understand the business vision from the data solutions and work with all project stakeholders
- Help Business Analysts to create data mapping documents that define the end to end pipeline
- Build and deliver data pipelines that ingests data (structured and unstructured) from multiple sources into the target data lake
- Build the data management layer in line with the business needs and standards defines
- Triage problems in the pipelines or data layers and effectively fixes them based on the priority
- Automate data loading during initial or incremental loads

Your Background Needs To Include:

- A passion for Big Data technologies, appreciating the value that can be brought in with an effective data management solution
- Have worked on real data challenges and handled huge volume, velocity and variety of data
- Understand Infrastructure concepts and have worked with multiple cloud tenants
- Proficient with data warehousing and traditional ETL technologies
- Strong experience in writing stored procedure, functions and triggers in SQL
- Strong experience on Azure ecosystem and have worked with data management on Databricks, ADF, Blob Store, ADLS etc.
- Strong coding experience in Spark - primarily PySpark. Must be able to effectively churn out complex transformation requirements with ease
- Solid programming skills and Python experience
- Implement complex data processing algorithms in Real Time in and efficient manner using Spark and other technologies
- Worked with both structured and unstructured data - basics of NLP
- Knowledge on latest database technologies like MongoDB, Cosmos, Cassandra etc.
- Knowledge on data analytics area using Visualization and Datamodelling tools
- Excellent analytical & problem-solving skills, willingness to take ownership and resolve technical challenges
- Industry certification in Data Engineering is an added advantage

This needs combining with a positive attitude and an ability to work within a large, globally dispersed project team in a multi-cultural environment. You also need to be a self-starter, a logical thinker and a quick learner, with strong initiative and excellent communication, interpersonal and presentation skills, able to write clearly and concisely. We believe in equality of opportunity for all job applicants regardless of gender, marital status, race, colour, nationality, ethnic origin, creed or religion, disability, sexual orientation or age. Specialising within Energy Trading, Oil & Gas, Financial Markets and TV & Entertainment, Eaglecliff Recruitment is ISO accredited, a Member of REC and listed within the top 4% for Financial stability by Dun & Bradstreet. Please telephone for an immediate response or email your CV for a reply within one hour. Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing

Reference: 1846987881

CareerAddict

Alert me to jobs like this:

Digital marketing manager in London, Full-time

Amplify your job search:

CV/résumé help

Increase interview chances with our downloads and specialist services.

CV Help

Expert career advice

Increase interview chances with our downloads and specialist services.

Visit Blog

Job compatibility

Increase interview chances with our downloads and specialist services.

Start Test