Big Data Developer
Posted on Mar 29, 2021 by Connect 44 AG
Our client, a well known Consulting Company in Switzerland, is currently looking for an experienced Big Data Developer, to support their projects based in Zurich - Switzerland
- Responsible to ingest data from files, streams and databases. Process the data using Spark, Python
- Develop programs in PySpark and Python as part of data cleaning and processing
- Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems
- Develop efficient software code for multiple use cases leveraging Python and Big Data technologies for various use cases built on the platform
Skills and experience required.
- Over all 7 to 12 years of IT experience. Extensive experience in Big Data, Analytics, ETL technologies
- Application Development background along with knowledge of Analytics libraries, statistical and big data computing libraries
- Minimum 4+ years of experience in Spark, Python/Scala/Java programming.
- Hands on experience in coding, designing and development of complex data pipelines using big data technologies
- Experience in developing applications on Big Data. Design and build highly scalable data pipelines
- Expertise in Python, SQL Database, Spark, non-relational databases
Knowledge of Palantir would be added advantage