Senior Python Software Engineer AWS Data Mesh Finance London
Senior Python Data Engineer (Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required by my asset management client in London.
You MUST have the following:
- Advanced ability as a Senior Python Data Engineer/Data Architect
- AWS (EC2, ECS, EKS, Glue)
- Excellent Python ability
- PySpark
- MWAA/Airflow/Dagster
- At least one of the following:
- Apache Iceberg
- DBT
- Dremio
- Snowflake
The following is DESIRABLE, not essential:
- Experience with data mesh architectures
Role: Senior Python Data Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required by my asset management client in London. You will join a number of teams that are responsible for the core engineering of a large amount of financial trading data. The data is currently ingested into, and stored in, an AWS data lake. This is being migrated to a data mesh architecture though. You will work within a team of 4-5 engineers that will contribute towards this migration, working with AWS Glue, Athena, Python, Java, Iceberg, DBT, Arrow and Dremio.
They have a very flexible hybrid working set up of 1-2 days/month in the office.
Duration: 12-24 months
Rate: £700-950/day
Reference: 2853845771
Senior Python Software Engineer AWS Data Mesh Finance London
Posted on Nov 20, 2024 by Joseph Harry Ltd
Senior Python Data Engineer (Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required by my asset management client in London.
You MUST have the following:
- Advanced ability as a Senior Python Data Engineer/Data Architect
- AWS (EC2, ECS, EKS, Glue)
- Excellent Python ability
- PySpark
- MWAA/Airflow/Dagster
- At least one of the following:
- Apache Iceberg
- DBT
- Dremio
- Snowflake
The following is DESIRABLE, not essential:
- Experience with data mesh architectures
Role: Senior Python Data Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required by my asset management client in London. You will join a number of teams that are responsible for the core engineering of a large amount of financial trading data. The data is currently ingested into, and stored in, an AWS data lake. This is being migrated to a data mesh architecture though. You will work within a team of 4-5 engineers that will contribute towards this migration, working with AWS Glue, Athena, Python, Java, Iceberg, DBT, Arrow and Dremio.
They have a very flexible hybrid working set up of 1-2 days/month in the office.
Duration: 12-24 months
Rate: £700-950/day
Reference: 2853845771
Alert me to jobs like this:
Amplify your job search:
Expert career advice
Increase interview chances with our downloads and specialist services.
Visit Blog