2296 IT & Software Developer jobs in the UK
Requirements
Must:
###
- Significant commercial experience in Data Engineering, specifically with production workloads on Azure and Databricks.
- Strong proficiency in PySpark/Spark SQL and distributed data processing.
- Proven experience in delivering solutions based on Medallion/Lakehouse architecture using Delta Lake.
- Solid understanding of dimensional modeling (Kimball), including surrogate keys, SCD types 1 and 2, and merge strategies.
- Operational experience with SLAs, observability, idempotent pipelines, reprocessing, and backfills.
- Strong grounding in secure Azure Landing Zone patterns.
- Proficiency with Git, CI/CD, automated deployments, and modern engineering standards.
- Effective communication skills to translate technical decisions into business outcomes.
###
Responsibilities
- Engineer scalable ELT pipelines using Lakeflow Declarative Pipelines, PySpark, and Spark SQL following a full Medallion Architecture (Bronze - Silver - Gold).
- Implement ingestion patterns for files, APIs, SaaS platforms (e.g., subscription billing), SQL sources, SharePoint, and SFTP employing ADF and metadata-driven frameworks.
- Apply Lakeflow expectations for data quality, schema validation, and operational reliability.
- Build clean, conformed Silver/Gold models aligned to enterprise business domains such as customers, subscriptions, deliveries, finance, credit, logistics, and operations.
- Deliver star schemas, harmonization logic, SCDs, and business marts to enhance high-performance Power BI datasets.
- Apply governance, lineage, and fine-grained permissions via Unity Catalog.
- Design and optimize orchestration using Lakeflow Workflows and Azure Data Factory.
- Implement monitoring, alerting, SLAs/SLIs, runbooks, and cost optimization across the platform.
- Build CI/CD pipelines in Azure DevOps for notebooks, Lakeflow pipelines, SQL models, and ADF artifacts.
- Ensure secure, enterprise-grade platform operation utilizing private endpoints, managed identities, and Key Vault.
- Contribute to platform standards, design patterns, code reviews, and future roadmap.
- Collaborate closely with BI/Analytics teams to deliver curated datasets that support dashboards across the organization.
- Influence architecture decisions and elevate engineering maturity within our growing data function.
###
Description
We are a leading UK consumer business currently on an exciting journey of data modernization, moving away from legacy systems and manual reporting. We are building a fully automated Azure Enterprise Landing Zone combined with Databricks Lakehouse, and we want your expertise to shape our new data platform. This is a rare opportunity for you to join early in the process, influence architecture, and define engineering standards that will support our Operations, Finance, Sales, Logistics, and Customer Care functions. If youre passionate about creating a best-in-class lakehouse from the ground up, we would love to hear from you! *Note: This position does not offer sponsorship or relocation.*
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2296 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Mas & Pas Limited, Spiderweb systems, EG Group, Bank of England, Computershare, Accenture, Ever Nimble among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 95 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 95 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.