Lead Data Engineer with Hadoop &/or Spark
Posted on May 6, 2020 by Schuback Search Associates
This highly visible company is seeking to hire an experienced Lead Data Engineer. The Quantitative Strategy team is responsible to design and develop the proprietary platforms that drive QIS business, spanning alternative Data Acquisition, Quantitative Research, Model Generation, Portfolio Construction, and more.
This role will focus on leading the effort to advance data strategies for portfolio management teams across QIS
Manage any necessary development team/data engineers
Evolve state-of-the-art data infrastructure to drive the investment process and thus the firm's bottom line
Work closely with Senior and Executive leadership, to ensure QIS Infrastructure platform remains best in class
Designing, developing, and maintaining a world-class, high-performing data platform to enhance research and portfolio management
Developing rigorous and scalable data management/analysis tools to support the data-intensive quantitative investment process
5+ years acting as a Tech Lead for a team focused on Data Engineering, Data Pipelines, etc.
Hands-on expertise in Hadoop and Hadoop ecosystem such as Spark/Scala
Data ingestion and management, Data APIs (multi-language support), and Big Data processing
Working experience with Enterprise Java development, JSI web stack, various visualization toolkits.
Knowledge of leading technology trends and best practices
Proven in ETL and data processing, know how to transform data to meet business goals.
Meaningful experience in using AWS stack is a plus ideal, but not required