Big Data Engineer - Remote
Posted on May 23, 2021 by Masento
Masentó are currently seeking a Big Data Engineer for our Consulting client in Sweden. This is a fully remote position for the duration.
- Experience working with large scale data systems using Hadoop Cloudera distribution and its ecosystem.
- Experience working with Scala/Java/Python
- Hands on experience with YARN & Spark with relevant experience is fine tuning & optimizing SPARK applications
- Working experience implementing data ingestion using HDFS, KAFKA, Spark, Scala/Java with Streaming.
- Strong experience in Hadoop technologies like HBASE, HIVE
- Should have good handle in database queries and unix background
- Good understanding an experience of Real Time/stream processing
- Airflow knowledge
- Good understanding of CI/CD with github and git actions.
Key Skills: Spark, Kafka, Scala, Python, Airflow, Git, CI/CD, Hadoop, Hive, HBase
Please apply if you are available and interested!