3082 IT & Software Developer jobs in the UK
Requirements
Must:
- Proven experience as a Tech Lead / Lead Data Engineer delivering AWS-based data platforms.
- Strong hands-on AWS experience, including:
- Amazon S3 (data lake patterns, partitioning, lifecycle policies, cost optimisation)
- AWS Glue (Jobs, Crawlers, PySpark, Glue Data Catalog, orchestration)
- Amazon Redshift (performance tuning, sort/dist keys, Spectrum, WLM)
- Strong development skills across:
- Python (including PySpark)
- SQL (DDL/DML, analytical queries, data performance considerations)
- Experience with Infrastructure as Code (Terraform or CloudFormation).
- CI/CD experience using tools such as GitHub Actions, Azure DevOps, CodePipeline, CodeBuild, etc.
- Strong understanding of security & governance in regulated environments:
- IAM, KMS encryption, Secrets Manager/SSM, audit logging
- Delivery capability across Agile (Scrum/Kanban) environments with strong backlog refinement discipline.
- Confident stakeholder management with the ability to explain technical choices and gain consensus.
Responsibilities
- Lead and mentor a small engineering team across data engineering, analytics engineering, and DevOps.
- Own the technical design of data ingestion, transformation, storage, and access patterns.
- Drive engineering standards including code quality, testing, CI/CD, Infrastructure as Code, and security-by-design.
- Translate high-level requirements into solution increments, technical designs, and well-scoped delivery tickets.
- Deliver and optimise data modelling approaches (e.g., star/snowflake schemas) and performance tuning practices.
- Build reliable and cost-effective ETL/ELT pipelines, including orchestration and event-driven patterns where appropriate.
- Partner with security stakeholders to ensure compliance, including IAM least privilege, encryption, auditability, and secure access controls.
- Implement and maintain CI/CD pipelines for data workflows and platform components.
- Ensure strong monitoring and operational discipline using cloud-native tooling and engineering best practice.
- Communicate technical decisions, trade-offs, risks, and delivery progress to senior stakeholders.
- Promote a culture of learning, quality, and continuous improvement.
Description
We are looking for a hands-on Tech Lead to lead a small team delivering secure, scalable data solutions within a highly regulated environment. You will take technical ownership across an AWS-based data platform using S3, Glue, and Redshift, working closely with delivery leadership, architecture stakeholders, and product teams to deliver incremental value. This role suits someone who can balance technical leadership, hands-on engineering, and stakeholder-facing communication, while maintaining strong standards around security, quality, and operational resilience. This is a hybrid role based in London, requiring one day a week on-site.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3082 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
The Scouts Association, Mas & Pas Limited, Delapt Technologies UK, Hillside Primary Care IT Services, OpenWorks Engineering, Ctrl Alt, Scottish Prison Service among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 93 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 93 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.