This Job Vacancy has Expired!

Data Architect - Spark/SQL/No-SQL/Hadoop/Cloud

Posted on Sep 28, 2019 by Sentinel IT LLP

Dublin, Ireland
IT
Immediate Start
£775 - £850 Daily
Contract/Project

Data Architect - Spark/SQL/No-SQL/Hadoop/Cloud

Our Client is a leading quantitative research and technology company. They are looking for a Big Data Architect who can help them design and build Big Data solutions, on premise and in the cloud. The successful Architect will also be involved with the full life cycle of Big Data solutions, working closely with the Big Data Platform Engineering team who build and operate the live platforms.

About the role

Responsibilities:

  • Architect, build and test data pipelines to extract, transform and load both live customer and historical data in a scalable manner
  • Work closely with data scientists and analysts to maximise the impact of available data to the performance of our algorithms
  • Own the Data strategy for storage, versioning and retrieval across the organisation
  • Be the chief advocate for data across Tractable, and support the development of our analytics platform

Requirements:

  • 2+ years commercial software engineering experience
  • Comfortable in handling large volume, unstructured data
  • Excellent understanding of at least one OO & Scripting programming languages
  • Spark, distributed file systems (Parquet), Databases (SQL & Hadoop and/or No-SQL)
  • Commercial experience of writing and optimizing SQL queries
  • Experience of cloud platforms (eg Amazon Web Services)

Advantageous Qualities:

  • Familiarity with migrations frameworks for change management (eg Flyway, Alembic)
  • Experience in feature engineering for Machine Learning applications
  • Experience building streaming pipelines (eg Kafka, Kinesis)

If you are interested in this opportunity please click apply


Reference: 762613376

Set up alerts to get notified of new vacancies.