Big Data Developer

Posted on Apr 16, 2019 by Stelfox Ltd

Dublin, Dublin Ireland
Information Technology
Immediate Start
Annual Salary
Contract/Project

Big Data Developer

Location: Dublin City Centre

Duration: 12 months rolling contract

Are you a Big Data Developer searching for your next contract position? A major client of Stelfox's are looking to recruit a Big Data Developer to join the team in Dublin in the creation of their new Big Data Pipeline in the Hadoop environment.

We are looking for someone skilled in Hadoop, Kafka, Scala, Python, Spark and Hive, with great communication skills. You'll be one of two developers on the team, so the ideal candidate will be someone who can work independently and really own and be proud of your work.

Are you ready to put your expertise in Big Data to work in a new challenge, in a hands-on, development position as you all work towards this new infrastructure? Then keep reading below for more.

Your day to day will include:

  • General Programming bearing in mind Big Data architecture of this new pipeline
  • Data formats and Big Data formats
  • SPARK written in Scala, Java or Python
  • Bash/Shell Scripting
  • Hadoop File System
  • An understanding of Javascript to host job configuration details
  • ETH (Jenkins/NEXUS/Maven/GIT/JIRA)
  • A knowledge of high-level Groovy Scripting, for use with Jenkins
  • Hive/BigSQL (TEXTFILE, SEQUENCEFILE, RCFILE, AVRO, ORCFILE, PARQUET)
  • SQL Hbase and Kafka for Real Time processing
  • Working closely with the team, mentoring junior members, and making sure everyone is focused on the end goal
  • Working closely with the dev team to ensure all bug fixes, and changes are correct before going live with the pipeline

This is a solid, 12+ month contract building the data pipelines, migrating from their previous system to Hadoop

If you are excited by the prospect of putting your skills to the test in a new position, apply today for immediate consideration or contact me directly (see below)

Reference: 694336051

Similar Jobs

Data Architect

Dublin, Dublin Ireland

Stelfox Ltd

Data Analyst

Dublin, Dublin Ireland

Stelfox Ltd

Data Engineering Manager

Dublin, Dublin Ireland

CPL Solutions

UI Developer

Dublin, Dublin Ireland

Solas IT