This Job Vacancy has Expired!

Senior Big Data Engineer

Posted on Apr 18, 2021 by Integral Ad Science

New York, NY 10001
IT
Immediate Start
Annual Salary
Full-Time


As a Senior Big Data Engineer you will design, implement, and maintain big data pipelines responsible for aggregating tens of billions of daily transactions. You will be part of a growing team to develop and mature IAS' capability in video ad verification, analytics and anti ad fraud software products. The ideal candidate is naturally curious, dedicated, detailed-oriented with a strong desire to work with awesome people in a highly collaborative environment. You should be able to not take yourself too seriously as well.


What you'll get to do:


Architect, design, code and maintain components for aggregating tens of billions of daily transactions
Work on Big Data technologies such as Hadoop, MapReduce, Kafka, and/or Spark in columnar databases on AWS
Contribute to the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for streaming & batch ETL and RESTful APIs
Provide leadership, work collaboratively, and be a mentor in an awesome team


You should apply if you have most of this:


Bachelors or Masters in Computer Engineering, Computer Science, Electrical Engineering or related field
5+ years of recent hands-on in Object Oriented language (Java, Scala, Python)
5+ years of experience designing and building data pipelines and data-intensive applications
Experience using Big Data frameworks (eg, Hadoop, Spark), databases (eg, RedShift, Snowflake) for complex data assembly and transformation
Strong knowledge of collections, multi-threading, JVM memory model, etc.
In-depth understanding of algorithms, performance, scalability, and reliability in a Big Data setting
Solid understanding of OLTP and OLAP systems, database fundamentals
Solid knowledge of SQL
Experience in full software development, Agile, and CI/CD
Experience building production level systems in a cloud environment (AWS, Azure or GCP)


What puts you over the top:


Orchestrating data pipelines using tools such as Airflow
Familiarity with messaging frameworks like Kafka or RabbitMQ
Experience with Spark streaming or Flink




Reference: 1170411101

Set up alerts to get notified of new vacancies.

Similar Jobs

Senior Big Data Engineer

Dayton, OR

Annual Salary

Senior Big Data Engineer

Canby, OR

Annual Salary

Senior Big Data Engineer

Portland, OR

Annual Salary

Senior Big Data Engineer

Hubbard, OR

Annual Salary

Senior Big Data Engineer

Woodburn, OR

Annual Salary

Senior Big Data Engineer

Evergreen Park, IL

Annual Salary

Senior Big Data Engineer

Austin, TX

Annual Salary

Senior Big Data Engineer

New York, NY

Annual Salary

Senior Big Data Engineer (CTV)

Austin, TX

Annual Salary

Senior Big Data Engineer (CTV)

Evergreen Park, IL

Annual Salary