This Job Vacancy has Expired!

Data Engineer

Posted on Feb 12, 2020 by eTeam Inc.

Zürich, Switzerland
IT
Immediate Start
Annual Salary
Contract/Project

Job Title: Data Engineer
Location: Zurich, Switzerland
Duration: 6 months

Mandatory Skills:

  • Java 8+, Spring boot, Spark framework, Hadoop, Impala

Desired Skills;

  • Working experience in Big Data platform is advantage.
  • React, Kotlin, Scala

Years of exp needed -
3-4 years experience of mentioned Big data technologies, is a Must.

Responsibilities for Data Engineer:

  • Create and maintain optimal data pipeline architecture,
  • Assemble large, complex data sets that meet functional/non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Work closely with the infrastructure team for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Sqoop, Rest API. file based and Kafka.

Qualifications for Data Engineer:

  • Candidate must be from Java background and experienced working in big data platform.
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Must have experience in operating in an agile and Devops environment.
  • Must have experience setting up Continues Integration and deployment process.

Technical Skills:

  • Experience with Java, Scala, Kotlin and big data tools: Hadoop, Spark, Kafka, Hive, Impala etc.
  • Experience with relational and NoSQL databases
  • Experience with bash Scripting, GIT SVN, Jenkins, Teamcity and deployment tools like Nolio.
  • Experience with object-oriented/object function Scripting languages: Python, Java, C++, Scala, etc.
  • Experience in DevOps tools like Docker, kubernetes, Gradle, Maven etc.
  • Experience in Hadoop platform like Cloudera, Hortonworks etc platform. Experience in debugging and monitoring Hadoop cluster.
  • Experience in TDD, BDD driven development using automated testing framework like Junit, Cucumber, Scala test, Mockito etc.
  • Experience in working with Agile methodologies like Scrum, Kanban etc. Also expertise in using tools like JIRA etc.
  • Experience in live streaming data processing using Spark streaming, Apache Flume etc.
  • Experience in performance tuning in Database as well as programming languages using different tools.
  • Experience in resource manager like YARN. Also experience in different HDFS file formats

Reference: 842887509

Set up alerts to get notified of new vacancies.

Similar Jobs

Hadoop- Big data Engineer

Genève, Switzerland

Annual Salary

Big Data - Hadoop-L2

Zürich, Switzerland

Annual Salary

Big Data Platform Engineer - Hadoop/DevOps/Admin

Not Specified, Switzerland

Annual Salary