This Job Vacancy has Expired!

Big Data Engineer (Spark, Kafka, Scala, Python, Airflow, Git, CI/CD, Hadoop, Hive, Hbase)

Octopus Computer Associates

Posted on May 25, 2021 by Octopus Computer Associates

Not Specified, Spain
IT
Immediate Start
Annual Salary
Contract/Project


Big Data Engineer (Spark, Kafka, Scala, Python, Airflow, Git, CI/CD, Hadoop, Hive, Hbase) - Remote

One of our Blue Chip Clients is urgently looking for a Big Data Engineer (Spark, Kafka, Scala, Python, Airflow, Git, CI/CD, Hadoop, Hive, Hbase).

For this role you can work full time remotely.

Please find some details below:

Key Skills: Spark, Kafka, Scala, Python, Airflow, Git, CI/CD, Hadoop, Hive, HBase

  • Experience working with large scale data systems using Hadoop Cloudera distribution and its ecosystem.
  • Experience working with Scala/Java/Python
  • Hands on experience with YARN & Spark with relevant experience is fine tuning & optimizing SPARK applications
  • Working experience implementing data ingestion using HDFS, KAFKA, Spark, Scala/Java with Streaming.
  • Strong experience in Hadoop technologies like HBASE, HIVE
  • Should have good handle in database queries and unix background
  • Good understanding an experience of Real Time/stream processing
  • Airflow knowledge
  • Good understanding of CI/CD with github and git actions..

Please send CV for full details and immediate interviews. We are a preferred supplier to the client.




Reference: 1206765525

Set up alerts to get notified of new vacancies.