Spark Architect - Leeds - Hybrid - 6 months

iBSC

Posted on Jun 18, 2024 by iBSC
Leeds, Yorkshire, United Kingdom
IT
Immediate Start
Annual Salary
Contract/Project

My customer is searching the market for a Spark Architect to work on a hybrid basis in Leeds x 3 days per week on a 6 months rolling contract.

  • Job Title: Spark Architect
  • Location: Hybrid - Leeds x3 days per week
  • Duration: 6 months
  • Inside IR35

As a Spark Architect you will be working for CUSTOMERS - GDT (Global Data Technology) Team, you will be responsible for:

  • Working on an Enterprise scale Cloud infrastructure and Cloud Services in one of the Clouds (GCP).
  • Drive Data Integration upgrade to PySpark.

Mandatory Skills

You need to have the below skills.

  • Many Years of IT Experience with Deep understanding of component understanding around Spark Data Integration (PySpark, Scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Spark SME - Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
  • To be able to traverse and explain the architecture you have been a part of and why any particular tool/technology was used.
  • Spark SME - Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark - SME Be able to understand Data Frames/Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitoring - Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
  • Cloudera (CDP) Spark and how the run time libraries are used by PySpark code.
  • Prophecy - High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.

Reference: 2778084655

https://jobs.careeraddict.com/post/92091665

This Job Vacancy has Expired!

iBSC

Spark Architect - Leeds - Hybrid - 6 months

iBSC

Posted on Jun 18, 2024 by iBSC

Leeds, Yorkshire, United Kingdom
IT
Immediate Start
Annual Salary
Contract/Project

My customer is searching the market for a Spark Architect to work on a hybrid basis in Leeds x 3 days per week on a 6 months rolling contract.

  • Job Title: Spark Architect
  • Location: Hybrid - Leeds x3 days per week
  • Duration: 6 months
  • Inside IR35

As a Spark Architect you will be working for CUSTOMERS - GDT (Global Data Technology) Team, you will be responsible for:

  • Working on an Enterprise scale Cloud infrastructure and Cloud Services in one of the Clouds (GCP).
  • Drive Data Integration upgrade to PySpark.

Mandatory Skills

You need to have the below skills.

  • Many Years of IT Experience with Deep understanding of component understanding around Spark Data Integration (PySpark, Scripting, variable setting etc.), Spark SQL, Spark Explain plans.
  • Spark SME - Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
  • To be able to traverse and explain the architecture you have been a part of and why any particular tool/technology was used.
  • Spark SME - Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
  • Spark - SME Be able to understand Data Frames/Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
  • Monitoring - Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
  • Cloudera (CDP) Spark and how the run time libraries are used by PySpark code.
  • Prophecy - High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.

Reference: 2778084655

CareerAddict

Alert me to jobs like this:

Amplify your job search:

CV/résumé help

Increase interview chances with our downloads and specialist services.

CV Help

Expert career advice

Increase interview chances with our downloads and specialist services.

Visit Blog

Job compatibility

Increase interview chances with our downloads and specialist services.

Start Test

Similar Jobs

Lead Project Manager (HR and Pensions)

Leeds, Yorkshire, United Kingdom

Lead VizRT Developer

Leeds, Yorkshire, United Kingdom