2080 IT & Software Developer jobs in the UK
Senior Data Engineer/Scientist
£60,000 - 70,000
Head Resourcing
Renfrew Street 77, Glasgow
£60,000 - 70,000
Requirements
Must:
We are looking for someone with 5-8+ years of experience in Data Engineering, with 2-3+ years of delivering production workloads on Azure and Databricks. You should have strong expertise in PySpark, Spark SQL, and distributed data processing. Proven experience in Medallion/Lakehouse delivery using Delta Lake and solid dimensional modeling knowledge (Kimball) including surrogate keys, SCD types 1/2, and merge strategies is essential. You must also possess operational experience with SLAs, observability, idempotent pipelines, reprocessing, and backfills. Additionally, a strong grounding in secure Azure Landing Zone patterns is crucial, as well as comfort with Git, CI/CD, automated deployments, and modern engineering standards. We value clear communication skills, especially your ability to translate technical decisions into business outcomes.
Responsibilities
In this role, you will engineer scalable ELT pipelines using Lakeflow Declarative Pipelines, PySpark, and Spark SQL across a full Medallion Architecture (Bronze, Silver, Gold). You will implement ingestion patterns for files, APIs, SaaS platforms (such as subscription billing), SQL sources, SharePoint, and SFTP using Azure Data Factory (ADF) along with metadata-driven frameworks. Additionally, you will apply Lakeflow expectations for data quality, schema validation, and operational reliability. You will be responsible for building clean, conformed Silver/Gold models aligned to enterprise business domains, delivering star schemas, harmonization logic, SCDs, and business marts to power high-performance Power BI datasets. Governance, lineage, and fine-grained permissions via Unity Catalog will also fall under your purview. Furthermore, you will design and optimize orchestration using Lakeflow Workflows and ADF, and implement monitoring, alerting, SLAs/SLIs, runbooks, and cost-optimization across the platform. Lastly, you will build CI/CD pipelines in Azure DevOps and contribute to platform standards, design patterns, code reviews, and the future roadmap.
Description
Joining this rapidly scaling UK consumer brand presents a unique opportunity to be part of a major data modernization program, moving away from legacy systems, manual Excel reporting, and fragmented data sources into a fully automated Azure Enterprise Landing Zone and Databricks Lakehouse. This role is pivotal in building a modern data platform from the ground up using cutting-edge technology like Lakeflow Declarative Pipelines, Unity Catalog, and Azure Data Factory. As part of our team, you will have the chance to influence architecture decisions, define engineering standards, pipelines, curated layers, and best practices that will support various business functions such as Operations, Finance, Sales, Logistics, and Customer Care. If you are excited about building a best-in-class Lakehouse from scratch, we invite you to apply!
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2080 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
ProCheckUp Limited, Deep Sea Electronics Ltd, Kirintec Limited, razorblue Careers, Bridge AI, Shiptheory, PASS (Portable Appliance Safety Services) Ltd among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 74 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 74 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.