This Job Vacancy has Expired!

Scala Developer

ComTech Europe Limited

Posted on Jun 10, 2022 by ComTech Europe Limited

Madrid, Comunidad de Madrid, Spain
IT
Immediate Start
€450 - €450 Daily
Contract/Project

Task description

As a Scala Developer, you will help us design, develop and maintain data pipelines that will deliver insights. By using a DevOps approach, you will make sure the overall system is running on all times by automating tasks so you can spend time on creating and not deploying. You will also make sure the system is appropriately tested and monitored by using adapted methods and tools.

Responsibilities:

  • Conceive and build data architectures
  • Participate in the short/mid/long term vision of the overall system
  • Execute ETL (extract/transform/load) processes from complex and/or large data sets
  • Ensure data are easily accessible and that their exploitation is performing as requested, even in highly scalable circumstances
  • Participate to the architecture and planning of the big data platform to optimize the ecosystem's performances
  • Create large data warehouses fit for further reporting or advanced analytics
  • Collaborate with machine learning engineers for the implementation and deployment of different solutions
  • Ensure robust CI/CD processes are in place

Profile:

  • A Master in Informatics, Engineering, Mathematics, or related field
  • Strong knowledge & proven experience of Scala
  • Strong knowledge of Spark
  • Database management of SQL and NoSQL databases
  • Strong knowledge of CI/CD concepts
  • Demonstrable experience with big data platforms (Hadoop, Cloudera, EMR, Databricks, ...)
  • Technical knowledge in:
    • Data pipeline management
    • Workflow management (Oozie, Airflow)
    • Large file storage (HDFS, Data Lake, S3, Blob storage,..)
  • Stream processing such as Kafka, Kinesis, Elasticsearch is a plus
  • Good knowledge of a cloud environment is a plus

2 days per week onsite in Madrid is required 3 days per week you can work remotely.

Reference: 1625627780

Set up alerts to get notified of new vacancies.