2866 IT & Software Developer jobs in the UK
PySpark Developer
£109,500 - 127,750
Randstad Digital
Hopton Street, South East London
£109,500 - 127,750
Requirements
Must:
- 5 years of hands-on experience with PySpark/Spark SQL
- Strong proficiency in AWS Data Stack: EMR, Glue, S3, Athena, and Glue Workflows
- Solid foundation in SAS for understanding and debugging legacy logic
- Expertise in ETL/ELT, dimensions, facts, SCDs, and data mart architecture
- Experience with parameterisation, exception handling, and modular Python design
Responsibilities
- Lead the end-to-end migration of SAS code to PySpark using automated tools and manual refactoring
- Design, build, and troubleshoot complex ETL/ELT workflows and data marts on AWS
- Optimise Spark workloads for execution efficiency, partitioning, and cost-effectiveness
- Implement clean coding principles, modular design, and robust unit/comparative testing
- Maintain Git-based workflows, CI/CD integration, and comprehensive technical documentation
Description
We are seeking a Lead PySpark Engineer for a 5-month contract, focused on a large-scale data modernization project transitioning legacy data workflows to a high-performance AWS cloud environment. This is a fully remote role for UK-based candidates, offering 33 days of holiday entitlement pro-rata. You will collaborate with our internal team to drive engineering excellence in the financial services industry.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find DevOps salaries in the UK here.
How many DevOps jobs are in the UK?
Currently, there are 2866 DevOps openings. Check also: Cloud jobs, AWS jobs, Azure jobs, GCP jobs, Kubernetes jobs, Docker jobs, Terraform jobs - all with salary brackets.
Is the UK a good place for DevOps?
The UK is one of the best countries to work as a DevOps. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for DevOps jobs in the UK?
City of Lincoln Council, Bluefruit Software Limited, Openda Ltd, National Highways, Ishida Europe Ltd, eonnext, Leger Shearings Group among others, are currently hiring for DevOps roles in the UK.
The company with most openings is Experis as they are hiring for 81 different DevOps jobs in the UK. They are probably quite committed to find good DevOps.
The company with most openings is Experis as they are hiring for 81 different DevOps jobs in the UK. They are probably quite committed to find good DevOps.