Overview:

Job Purpose

Responsible for maintaining large mortgage and real estate data sets for ICE Data and Analytics to produce data products and custom analytics tools. Responsibilities include designing, building, and maintaining the infrastructure and systems that enable the collection, storage, processing, and analysis of large volumes of ICE mortgage and real estate data.

Responsibilities

Understanding the business need, securing the right data sources, designing usable data models, and building robust & dependable data pipelines

Work with and data scientists and an application research and development team who use data and machine learning solutions to uncover valuable insights from ICE mortgage and real estate data

Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources.

Ensure data quality, consistency, and accuracy by building out robust data monitoring processes.

Build scalable data pipelines (SparkSQL & PySpark) leveraging Airflow scheduler/executor framework

Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that support ICE mortgage performance and real estate data platforms.

Knowledge and Experience

5+ years of relevant industry experience with a BS/Masters, or 2+ years with a PhD

Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)

Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions

Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks

Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)

Excellent written and verbal communication skills

Schedule

This role offers work from home flexibility of one day per week. 

New York Base Salary Range 

  

The expected base salary for this role if located in New York City is between 139,100 - 195,700 USD.  The base salary range does not include Intercontinental Exchange’s incentive compensation.  While we provide this range as general guidance, at ICE we compensate employees based on the skillset and experience of the individual.  

Intercontinental Exchange, Inc. is an Equal Opportunity and Affirmative Action Employer.  All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin or ancestry, age, disability or veteran status, or other protected status.   

#LI-RS1

#LI-Hybrid