This Job Vacancy has Expired!

Data Engineer

Red - The Global SAP Solutions Provider

Posted on Apr 14, 2021 by Red - The Global SAP Solutions Provider

Not Specified, Sweden
IT
Immediate Start
£37.8 - £42.1 Hourly
Contract/Project


Data Engineer/Sweden (Remote)/12 months/Start ASAP

This is a combination of on-prem + AWS technologies

Description:

* Experience working with large scale data systems using Hadoop and its ecosystem.
* Experience working with Scala/Java/Python
* Good knowledge on S3 and creating Data Pipelines
* Good knowledge on Lambda functions and AWS Kinesis/Kafka
* Hands on experience with YARN & Spark with relevant experience is fine tuning & optimizing SPARK applications
* Working experience implementing data ingestion using HDFS, KAFKA, Spark, Scala/Java with Streaming.
* Strong experience in Hadoop technologies like HBASE, HIVE and help build prototypes for new tools/products
* Should have good handle in database queries and Unix background
* Good understanding an experience of Real Time/stream processing
* Airflow knowledge
* Good understanding of CI/CD with GitHub and git actions.




Reference: 1164846247

Set up alerts to get notified of new vacancies.

Similar Jobs

Data Engineer

Stockholm, Sweden

£4.63k - £5.47k Monthly