This Job Vacancy has Expired!

Data Engineer - PySpark (Python Scripting)

Avance Consulting (Europe) Limited

Posted on Jun 5, 2021 by Avance Consulting (Europe) Limited

Zürich, Switzerland
IT
Immediate Start
Annual Salary
Contract/Project


Over all 7 to 12 years of IT experience. Extensive experience in Big Data, Analytics, ETL technologies
Minimum 2 to 4 years of experience in Spark programming using either Python/Scala/Java.
Application Development background on big data along with knowledge of Analytics libraries and big data computing libraries
Hands on experience in coding, designing and development of complex data pipelines using big data technologies
Experience in developing applications on Big Data. Design and build highly scalable data pipelines
Experience in Python, SQL Database, Spark, non-relational databases
Responsible to ingest data from files, streams and databases. Process the data using Spark, Python
Develop programs in PySpark as part of data cleaning and processing
Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems
Develop efficient software code for multiple use cases leveraging Python and Big Data technologies for various use cases built on the platform
Provide high operational excellence guaranteeing high availability and platform stability
Implement scalable solutions to meet the ever-increasing data volumes, using big data/Palantir technologies Pyspark, any Cloud computing etc.
Knowledge of Palantir would be added advantage
Individual who can work under their own direction towards agreed targets/goals and with creative approach to work
Intuitive individual with an ability to manage change and proven time management
Proven interpersonal skills while contributing to team effort by accomplishing related results as needed




Reference: 1219101261

Set up alerts to get notified of new vacancies.