3349 IT & Software Developer jobs in the UK
Lead Data Engineer
£88,000 - 97,900
Stealth IT Consulting Limited
Dyer's Wynd, Sheffield
£88,000 - 97,900
Requirements
Must:
- Proven experience as a Lead or Senior Data Engineer in enterprise-scale environments
- Hands-on expertise with Hadoop, Spark, and Splunk
- Advanced Python development skills
- Experience designing and optimising high-performance data pipelines
- Strong understanding of CI/CD, source control, and automated testing
- Analytical, problem-solving, and leadership skills
- Experience working in regulated, enterprise environments (e.g., banking, fintech, government)
- Agile delivery experience (Scrum/Kanban)
- Ability to mentor and uplift team performance
- Strong communication and stakeholder engagement skills
- Collaborative, delivery-focused mindset with high accountability
- Knowledge of control, compliance, and regulatory requirements
- Up-to-date awareness of modern tools, cybersecurity, and data privacy regulations
- Champions innovation, advanced technologies, and best practices
Responsibilities
- Lead the design, development, and optimisation of enterprise data engineering platforms
- Build and maintain robust ETL/ELT pipelines integrating large, complex datasets
- Work with structured, semi-structured, and unstructured data across SQL and NoSQL technologies
- Develop solutions using Hadoop, Spark, and Splunk in large-scale environments
- Write maintainable Python code, applying object-oriented and functional programming principles
- Implement and maintain CI/CD pipelines, automated testing, and version control
- Collaborate with BI, Analytics, and downstream teams to support reporting and insights
- Pair program and mentor other engineers to promote knowledge sharing and code quality
- Define and maintain technical test plans including unit and integration tests
- Promote SRE principles to ensure service resilience, sustainability, and recoverability
Description
We are seeking an experienced Lead Data Engineer to design, develop, and optimise enterprise-scale data platforms for large, regulated organisations, ideally in banking, financial services, or other regulated sectors. This role requires hands-on technical expertise, leadership, and a consulting mindset to deliver scalable, resilient data solutions while promoting best practices and operational excellence. The position is a hybrid role based in Sheffield, offering a contract for 6 months with the possibility of extension at a rate of £400 per day inside IR35.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3349 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Bluefruit Software Limited, City of Lincoln Council, EG Group, Counter Terrorism Policing, Unum Group, Ishida Europe Ltd, RevOps Automated among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 88 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 88 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.