Senior Data Engineer (Spark)

Posted on Jan 10, 2020 by Visionaire Partners

Atlanta, GA 30301
IT
Immediate Start
Annual Salary
Full-Time

Senior Data Engineer (Spark)

Exciting opportunity for a Senior Data Engineer to join an Atlanta based Enterprise Data team in Sandy Springs!

In this role, you will play a key part in building and managing our newly established cloud-based data ecosystem! You will be responsible for building and managing data pipelines and processing, data management, and data security functions. Daily activities will consist of designing, developing and maintaining reliable automated data solutions based on the identification, collection and evaluation of business requirements, including: data models, database objects, and stored procedures. Also, you will have the opportunity to enhance and develop brand new data processes.

50% technical and hands-on programming
30% functional working with the business and understanding how architecture translates to design
20% mentor/leadership

Enjoy this direct-hire position in the Sandy Springs that offers an excellent culture/environment, modern office space, fully stocked kitchen/break room with mini arcade feel, Summer and Winter Fridays where you can leave after 2:00pm (May - July and end of November - December) and flexible schedule!

REQUIRED EXPERIENCE:

  • 5+ years Data Engineering experience
  • 2+ years experience with Spark
  • Strong experience with batch and Real Time data pipelines
  • Current hands-on programming experience (Java, Scala, etc)
  • ETL processes and data transformation
  • SQL knowledge
  • Data Warehouse and Data Structure (modify existing models)
  • Cloud
  • DevOps exposure with CI/CD tools
  • Excellent communication skills - will be working with "the business" and leadership as well as mentoring junior and mid-level engineers

PREFERRED EXPERIENCE:

  • Talend (HIGHLY preferred)
  • PySpark (HIGHLY preferred)
  • Python, Java
  • SSIS/SSRS
  • Understanding of data science and visualization (Hadoop, Spark, Databricks,)
  • NoSQL databases and modelling (Cassandra, HBase, MongoDB)
  • Schema
  • Exposure to Azure cloud

Reference: 825723686

Set up alerts to get notified of new vacancies.

Similar Jobs

Technical Delivery Manager-Perm, Atlanta GA

Atlanta, GA

$120k - $150k Annual

Java Developer

Atlanta, GA

$110k - $110k Annual

Data Architect

Atlanta, GA

$135k - $135k Annual