AWS Data Engineer
Posted on Jan 14, 2021 by Fairfield Consultancy Services Ltd
Our client is looking for a AWS Data Engineer in Dublin, Ireland. This is a 6 months contract role.
Hands-on experience on relevant skills related to AWS Data Lake inclusive of Glue, S3, Athena, EMR, DynamoDB along with PySpark (mandatory) and CI/CD exposure.
Hands on experience with AWS ETL services like Glue, Lambda, EMR and experience in Real Time AWS/Big Data Analytics AWS with Python hands-on programmer requirement.
Good to have knowledge on terraform Knowledge and experience in Agile project delivery, ie, sprint planning and updates using tools like Atlassian JIRA etc.
Experience on Python and/or Spark programming, working with data transformation, data migration implementations and creation and use of functions, libraries, data frames
Must have experience using Python IDEs, debugging, error-handling
Knowledge on Python integration with Cloud service tools for ETL
Handling CDC data with AWS pipelines.
Willing to develop and test code using Python and AWS glue, lambda.
The candidate MUST be eligible to work in Ireland.