Position Summary

As a Senior Data Engineer, the candidate will be responsible in integrating, analyzing raw data, developing, and maintaining datasets and improving data quality and efficiency. The engineer needs to have strong analytical skills and will involve various methods to integrate different data sources, transform data into useful business drivers. Candidate should be intimate with several data stores, integration tools/technologies, data transformation methods, data modelling and analysis. Candidate should be able to work across projects involving multiple stakeholders. Having strong technical and programming skills while working with business, architects, partners to resolve complex system issues.

Responsibilities

Develops and maintains scalable data pipelines, integration tools and builds out new API integrations to support continuing increases in data usage, volume, and complexity.

Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition.

Strong Programming, SQL skills across structured and unstructured data. Intimate with most Azure services including ADF, Azure Functions, ASB, API, Synapse, SQL

ETL, ELT with Data Lake and Data Warehouse data platforms

Should be self-starter with strong execution and delivery mindset.

Monitor and manage database performance

Excellent knowledge of data backup, recovery, security, integrity and SQL

Hands-on experience with database standards and end user applications

Designs data integrations, data quality framework and integrate it with monitoring services. Strong hands-on capabilities across integration toolsets including but not limited to ADF, Replication, CDC etc.

Integrate data from different SORs, combine raw information and create resulting models ready for consumption.

Interpret trends and patterns.

Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.

Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, DB, SQL, and data pipelines performance tuning, optimizing data delivery, and automating manual processes

Build solution prototypes as needed and write algorithms against data.

Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.

Works closely with a team of frontend and backend engineers, product managers, and analysts

Data Management, Modelling, Architecture, and Integration

Develop and maintain database documentation, including data standards, procedures and definitions for data elements and tables in the company.

Experience and Competencies

Minimum Requirements

At least 10 years of experience in technology, specifically in the data field

Bachelors degree in technology related discipline is preferred. In lieu of degree, 14 years of experience is required.

Solid balance between architecture strategy, technical IT skills and strong business process knowledge

4+ years of Python, NodeJs or Java development experience

4+ years of experience with schema design and dimensional data modeling

Experience in technology platforms across Microsoft Azure, Cloud Computing, Software as a Services (SaaS), Integration Platform as a Service (IPaaS), Infrastructure as a Service (IaaS)

Previous experience as a data engineer or in a similar role

Technical expertise with data models, data mining, and segmentation techniques

Hands-on 7+ years' experience with SQL, Data integration, Data analysis, Data Modelling, and design

Experience working and implementing solutions with Microservices Architecture

Experience working with Data warehousing and Data Lake solutions.

Demonstrated ability to instrument Data Quality & Management standards and processes.

4+ years working with data integration and ETL tools, such as Azure Data Factory, CDC, Replication, Talend, Informatica etc.

Strong problem-solving and analytical skills

Excellent communication and collaboration abilities

Adaptability and a willingness to learn new technologies and techniques.

Ability to work with CI/CD pipelines and Automation.

Demonstrated ability to handle/organize multiple complex technical projects simultaneously without compromising the quality of work or the final product.

Demonstrated strong analytical & troubleshooting skills, as well as excellent written and verbal communication skills.

Ability to understand the long-term ("big picture") and short-term perspectives of situations and how they relate to achieving targeted business outcomes.

Ability to estimate the financial and business impact of technology alternatives.

Ability to apply multiple technical solutions to enable future-state business capabilities that, in turn, drive targeted business outcomes.

Ability to quickly comprehend the functions and capabilities of existing, new, and emerging technologies that enable and drive new business designs and models.

Demonstrated ability to work well with others and be respected as a leader.

Highly Desired

Masters in computer science or related field is a plus.

Data engineering certifications is a plus

There will be periodic requirements to travel for in-person events, at the discretion of your manager or the requirement of the company.