Senior Data Engineer

Posted on Sep 10, 2024 by Gridware
San Francisco, CA
Engineering
Immediate Start
Annual Salary
Full-Time
Gridware exists to enhance and protect the mother of all networks: the electrical grid. The grid touches everything, and when it grinds to a halt, the consequences can be dire: wildfires burn, land is destroyed, property is damaged, progress stops, and lives are lost.

Our team engineers an advanced sensing system to continuously analyze both the electrical and mechanical behavior of grid assets. Utilizing high-precision sensor arrays, the system identifies and allows preemptive mitigation of faults. The technology has been proven with utilities to bolster safety, reliability, and reduce customer outage durations. The demand for power will only increase. We protect the grid of today while we build the grid of tomorrow.

Gridware is privately held and backed by the best climate-tech and Silicon Valley investors. We are headquartered in the Bay Area in northern California.

Role Description:

The Senior Data Engineer is responsible for designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems. This role involves handling large-scale sensor data, ensuring data integrity, and enabling seamless data flow for analysis and decision-making.

Responsibilities:

The Senior Data Engineer will, as a starting point, be responsible for the following:

Design, develop, and maintain scalable data pipelines and architectures.

Implement data ingestion, transformation, and storage solutions.

Ensure data quality and integrity across various data sources and destinations.

Collaborate with software engineers, data scientists, analysts, and other stakeholders to meet data requirements.

Optimize and tune data workflows for performance and efficiency.

Monitor, troubleshoot, and resolve issues in data pipelines and related systems.

Document data processes, architecture, and workflow procedures.

Required Skills:

5+ years’ proven experience in data engineering or a similar role.

Strong proficiency in SQL and experience with relational and time series databases

Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka).

Proficiency in Python

Experience with Databricks, Grafana

Knowledge of data modeling, ETL processes, and data warehousing concepts.

Knowledge of version control, automated deployments, and testing pipelines

Familiarity with data governance and data security best practices.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration skills.

Bonus Skills:

The ideal candidate will also have:

Knowledge of machine learning and data science concepts.

Experience with real-time data processing frameworks

Familiarity with IOT / embedded systems

Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

Experience in high-growth startup environments where you must wear many hats

Experience with Protobuf

Familiarity with monitoring and alerting systems for real-time IoT time series analysis.

We encourage you to apply even if you don’t have all of the bonus skills listed above. We believe diverse perspectives drive innovation and growth.

Benefits:

Flexible hours / hybrid schedule for those in the Bay Area

Health, Dental & Vision (Gold and Platinum plans fully covered)

Paid parental leave

Commuter allowance

Company-paid training

Gridware is an equal opportunity employer. We want applicants of diverse backgrounds and hire without regard to color, gender, religion, national origin, citizenship, disability, age, sexual orientation, or any other characteristic protected by law.

Reference: 197979502

https://jobs.careeraddict.com/post/95047310

Senior Data Engineer

Posted on Sep 10, 2024 by Gridware

San Francisco, CA
Engineering
Immediate Start
Annual Salary
Full-Time
Gridware exists to enhance and protect the mother of all networks: the electrical grid. The grid touches everything, and when it grinds to a halt, the consequences can be dire: wildfires burn, land is destroyed, property is damaged, progress stops, and lives are lost.

Our team engineers an advanced sensing system to continuously analyze both the electrical and mechanical behavior of grid assets. Utilizing high-precision sensor arrays, the system identifies and allows preemptive mitigation of faults. The technology has been proven with utilities to bolster safety, reliability, and reduce customer outage durations. The demand for power will only increase. We protect the grid of today while we build the grid of tomorrow.

Gridware is privately held and backed by the best climate-tech and Silicon Valley investors. We are headquartered in the Bay Area in northern California.

Role Description:

The Senior Data Engineer is responsible for designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems. This role involves handling large-scale sensor data, ensuring data integrity, and enabling seamless data flow for analysis and decision-making.

Responsibilities:

The Senior Data Engineer will, as a starting point, be responsible for the following:

Design, develop, and maintain scalable data pipelines and architectures.

Implement data ingestion, transformation, and storage solutions.

Ensure data quality and integrity across various data sources and destinations.

Collaborate with software engineers, data scientists, analysts, and other stakeholders to meet data requirements.

Optimize and tune data workflows for performance and efficiency.

Monitor, troubleshoot, and resolve issues in data pipelines and related systems.

Document data processes, architecture, and workflow procedures.

Required Skills:

5+ years’ proven experience in data engineering or a similar role.

Strong proficiency in SQL and experience with relational and time series databases

Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka).

Proficiency in Python

Experience with Databricks, Grafana

Knowledge of data modeling, ETL processes, and data warehousing concepts.

Knowledge of version control, automated deployments, and testing pipelines

Familiarity with data governance and data security best practices.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration skills.

Bonus Skills:

The ideal candidate will also have:

Knowledge of machine learning and data science concepts.

Experience with real-time data processing frameworks

Familiarity with IOT / embedded systems

Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

Experience in high-growth startup environments where you must wear many hats

Experience with Protobuf

Familiarity with monitoring and alerting systems for real-time IoT time series analysis.

We encourage you to apply even if you don’t have all of the bonus skills listed above. We believe diverse perspectives drive innovation and growth.

Benefits:

Flexible hours / hybrid schedule for those in the Bay Area

Health, Dental & Vision (Gold and Platinum plans fully covered)

Paid parental leave

Commuter allowance

Company-paid training

Gridware is an equal opportunity employer. We want applicants of diverse backgrounds and hire without regard to color, gender, religion, national origin, citizenship, disability, age, sexual orientation, or any other characteristic protected by law.

Reference: 197979502

Share this job:
CareerAddict

Alert me to jobs like this:

Amplify your job search:

CV/résumé help

Increase interview chances with our downloads and specialist services.

CV Help

Expert career advice

Increase interview chances with our downloads and specialist services.

Visit Blog

Job compatibility

Increase interview chances with our downloads and specialist services.

Start Test