Senior Data Engineer (Java, Spark, AWS)
Posted on Nov 13, 2018 by Capital One
At Capital One, we're building a leading information-based technology company. Still founder-led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. We are succeeding because they are succeeding.
Guided by our shared values, we thrive in an environment where collaboration and openness are valued. We believe that innovation is powered by perspective and that teamwork and respect for each other lead to superior results. We elevate each other and obsess about doing the right thing. Our associates serve with humility and a deep respect for their responsibility in helping our customers achieve their goals and realize their dreams. Together, we are on a quest to change banking for good.
Senior Data Engineer (Java, Spark, AWS)
Do you want to re-imagine how we manage risk and build great products that users love? This may be the place for you, if:
You're passionate about engineering and obsess about code quality, performance, and CI/CD
You like to work with modern architecture and latest open source technologies: Microservices, Docker, Java, Python, R, Kafka, Spark, and many many more
You take an interest in infrastructure resiliency and how your code actually works at runtime: OS, network, and AWS cloud
You thrive in a continuously learning and collaborative environment by reviewing other's code and asking them to do the same for you.
You participate in forums, hackathons, meetups, and conferences
You own your work by building systems to succeed in production, and you fix them when they don't
By joining our Risk and Governance team, you will:
Build data ecosystems that are aligned with Enterprise standards and create a robust data environment which will enable effective controls, create operational efficiency and enable Machine Learning for our users.
Work with data scientists to define best practices and help them to perform advanced data science, modeling and analytics. Integrate with existing Data Management platforms to ensure discoverability, accuracy and currency of data. Become an SME to develop intelligent risk management and fraud intelligence engines and services.
Work to deliver environments that are integrated with all data management and data access & protection platforms to provide a high fidelity, well managed data discovery for model builds
Integrate with model development environments and leverage model progression pipelines to streamline our ability to promote models to productions
Integrate with model development execution platforms
Build microservices to fully automate and integrate the full lifecycle of issues & events management into our real-time, event-based data ecosystem in the public cloud
Build platforms and ML-driven capabilities to support investigations of AML and other financial crimes
Develop governance capabilities for the company's advanced analytic environments where data scientists rapidly build and deploy models & algorithms
Bachelor's Degree or Military experience
At least 5 years of experience in software engineering
At least 3 years of experience with Java programming
At least 1 year of experience working with AWS
Experience in designing dynamically scalable, highly available, fault-tolerant, and reliable applications on AWS
Deep knowledge of appropriate AWS services to design based on given requirements (including but not limited to environment networking, security & compliance, compute, data security, logging, identity and access management, data storage and management, and analytics)
Experience in migrating complex, multi-tier applications on AWS
Experience in designing and deploying enterprise-wide scalable operations & infrastructure on AWS
2+ years of experience delivering analytical data warehouse solutions
3+ years of experience building data pipelines and fit for purpose data stores
1+ years of experience working with Spark
1+ years of experience working with microservices
1 + years of experience working with automated build and continuous integration systems
At this time, Capital One will not sponsor a new applicant for employment authorization for this position.