3196 IT & Software Developer jobs in the UK
Lead Azure Databricks Engineer
£80,000 - 90,000
Newgate Street, London
£80,000 - 90,000
Requirements
Must:
- Expert-level hands-on experience with Azure Data Services and Databricks in enterprise, highly regulated environments.
- Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns, distributed compute, data modelling, and performance optimisation.
- Strong programming skills in Python, PySpark, and Spark SQL, with experience implementing CI/CD pipelines (Azure DevOps, branching/merging, automation).
- Solid knowledge of data governance, lineage, access controls, secure cloud engineering, and FinOps principles.
- Exceptional communication and leadership skills with the ability to influence senior stakeholders and deliver results in fast-paced, high-expectation environments.
Responsibilities
- Design, develop, and optimise large-scale cloud data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark, and Unity Catalog.
- Collaborate with underwriting, actuarial, Delegated Authority, bordereaux, exposure management, reinsurance, finance, and Solvency II teams to meet Lloyds market and regulatory requirements.
- Translate business needs into scalable cloud data architectures by partnering with architects, SMEs, product owners, and senior leaders.
- Own and resolve complex technical challenges while championing CI/CD automation, cloud-native best practices, data lifecycle management, and high engineering standards.
- Oversee end-to-end data engineering delivery, ensuring pipeline reliability, observability, performance, resilience, and continuous improvement.
Description
We are a well-known Global Consulting firms Insights and Data Practice, located in London with a hybrid working model. We offer a fantastic opportunity for a Lead Azure Databricks Engineer to join our team and shape our Azure and Databricks strategy. We provide a competitive salary of £80-90k plus 15% cash flex for additional benefits or as cash each month, and a bonus structure. You will have a role that involves working from our offices, client sites, and your home based on your needs and those of the business.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3196 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Arctic Shores, Bluefruit Software Limited, Leger Shearings Group, eonnext, Dirty Martini Marketing, Roots Plants, Flowmotion among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 100 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 100 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.