This Job Vacancy has Expired!

Senior Big Data Developer

Posted on Nov 15, 2018 by Request Technology - Anthony Honquest

Virginia, VA
Information Technology
Immediate Start
$110k - $135k Annual

Senior Big Data Developer
McLean, VA
$110-135K +bonus

Prestigious Enterprise Company is seeking a Big Data Engineer who has Nifi (primary focus) and Kafka skillsets to work on its big data acquisition team. Additionally, Python and PySpark skills and AWS experience is desired.

Responsibilities include:

Responsible for delivery in the areas of: big data engineering mainly data acquisition technology implementations (Nifi & Kafka)

Develop scalable and reliable data solutions to move data across systems from multiple sources in Real Time as well as batch modes (Nifi/Kafka/Spark)

Construct data staging layers and fast Real Time systems

Utilize expertise in models that leverage the newest data sources, technologies, and tools, such as machine learning, Python, Hadoop, Spark, AWS, as well as other cutting-edge tools and applications for Big Data

Investigate the impact of new technologies, applications, and data sources on the future secondary mortgage business

Demonstrated ability to quickly learn new tools and paradigms to deploy cutting edge solutions

Develop both deployment architecture and scripts for automated system deployment in AWS

Create large scale deployments using newly researched methodologies

Work in Agile environment

Experience mentoring junior engineers


Bachelor's degree in Mathematics, Statistics, Computer Science, related field, or equivalent work experience

4+ years of experience with Nifi & Kafka

4+ years of experience with Hadoop including Hive and Spark

At least 3 years' experience in Python & PySpark

3+ years of experience working with AWS

5-8 years of experience in Software development, ideally 8+ years

Key to success in this role:

Great Nifi development coupled with Kafka, Python and PySpark Skills

Deep curiosity to learn new tools and technologies and apply them

Intellectual agility and interpersonal flexibility

Strong communication skills

Ability to work with and collaborate across the team

Top 3 Personal Competencies to possess:

Seek and Embrace Change - Continuously improve work processes rather than accepting the status quo

Growth and Development - Know or learn what is needed to deliver results and successfully compete

Leadership - Set and execute upon a clear vision, strategy, and/or goals

Preferred Skills

Master's Degree in Computer Science

2+ years of experience working with financial data

2+ years of experience with NoSQL databases

Strong communication skills, with the ability to work both independently and in project teams

Reference: 568935921

Similar Jobs

Senior Big Data Developer

Virginia, VA

Request Technology - Anthony Honquest