This Job Vacancy has Expired!

Data Engineer-Perm,Richardson,TX

Posted on Mar 19, 2020 by Electronic Transaction Consultants Corporation

Richardson, TX 75080
IT
Immediate Start
$90k - $120k Annual
Full-Time

Job Summary

The data engineer will work with software development teams and data scientists to develop data pipeline architectures capable of handling complex data sets quickly and securely as well as to productize data science solutions. The ideal candidate will be able to advise product teams as the best practices in handling large and complex data sets and help data scientists convert proof of concept solutions into fast and efficient production-ready systems.

Essential Functions

  • Work with product teams and data scientists to improve the efficiency and speed of computational models
  • Create and maintain data pipeline architectures to automate the processing of large and complex data sets
  • Transform complex analytical models into fast, scalable, and production-ready solutions
  • Stand-up and maintain and update data processing infrastructures
  • Work with product teams and data scientists to develop a wide variety of data products

Required Experience:

Competencies

  • Proficient in SQL to include schema design, database definition, and advanced queries
  • Experience with MPP data architectures such as Kafka, Spark, or Hadoop
  • Experience with Scripting languages for automating repetitive tasks
  • Experience building optimizing data pipelines, architectures, and data sets
  • Ability to and experience with creating automated data pipelines for complex systems
  • Ability to work with product teams, data scientists, and other stakeholders as well as
  • Assist product teams with data-related technical issues and support their data infrastructure
  • Excellent verbal and written communications skills along with the ability to present technical data and approaches to both technical and non-technical audiences
  • Experience in working with NoSQL databases
  • Background designing and developing dashboards and other data products
  • Ability to work remotely and with remote teams

Architectures used

  • Micro Service Architecture
  • Event Driven Architecture
  • Topic based Publish-Subscribe Design

Technologies used

  • Hadoop
  • Kudu
  • Kafka
  • Hazelcast
  • Streamsets
  • Jaspersoft

Spring

Required knowledge of Programming Languages

  • Java
  • Python
  • SQL
  • Scala (Optional)

Optional Technologies

  • Containerization (Kubernetes or Docker)
  • Continuous Integration and Continuous Delivery Principles
  • Linux Server Administration

Benefits:

This position will be offered a full suite of benefits, including medical, dental and vision benefits, company-paid life and disability insurance, as well as a 401k vested within 2 years with a 4% company match.

Reference: 865751102

Set up alerts to get notified of new vacancies.

Similar Jobs

Data Engineer-Perm,Richardson,TX

Richardson, TX

$90k - $120k Annual