Data Engineer - PySpark - Airflow - Unix - CI/CD - Lithuania

Empiric has received an exciting opportunity for an Data Engineer with good experience in PySpark, Airflow and proficiency in Unix. Docker and Kubernetes experience are also required.

The Data Engineer will troubleshoot data pipelines and address issues with Real Time, batch processing.

Plus Develop ETL process and data flows using PySpark and Airflow.

Remote and a few days in the office initially

Skills/Experience:

• PySpark & Airlow
• Unix
• Docker & Kubernetes
• CI/CD Tools: GitHub Actions
• Maintenance & troubleshooting
• Understanding & ensuring data quality, integrity, governance

Term: 6 to 18 Months plus extensions

Good day rate (B2B is fine) + Starter Bonus + Free Lunch Club experience

This is a critical position, please respond to this advert or reach out to Woody for a confidential chat and more details on rate and this terrific project.