3001 IT & Software Developer jobs in the UK
Lead Azure Databricks Engineer - Insurance
£30,000 - 60,000
Winchester Street, London
£30,000 - 60,000
Requirements
Must:
- Expert-level hands-on experience with Azure data services and Databricks in enterprise-scale environments.
- Strong knowledge of Delta Lake, Medallion architecture, distributed compute and Lakehouse engineering patterns.
- Advanced Python, PySpark and Spark SQL skills, including deploying data workloads through Azure DevOps CICD, branching/merging and automated testing.
- Solid understanding of data governance, lineage, access controls, FinOps practices and secure cloud engineering.
- Excellent communication skills with the ability to articulate technical topics clearly to senior stakeholders and guide cross-functional discussions.
- A strong delivery focus with a consistent track record of taking ownership and completing major engineering initiatives.
- Experience operating in fast-paced consulting environments with evolving priorities and demanding timelines.
- Essential: hands-on experience working within the Lloyds of London / London Market insurance sector.
Responsibilities
- Lead the engineering, optimisation and governance of Azure-based data platforms, spanning ADF, Data Lake, Azure Functions, Key Vault, Databricks, Delta Lake, PySpark and Unity Catalog.
- Collaborate closely with insurance domain teams including Underwriting, Actuarial, Delegated Authority, Bordereaux, Exposure Management, Reinsurance, Finance, Risk and Solvency II, delivering solutions aligned to Lloyds Market standards.
- Translate business, regulatory and operational requirements into scalable and robust cloud data solutions.
- Quickly diagnose and resolve high-complexity technical challenges, providing clear direction and decisive technical leadership.
- Establish and champion best-practice patterns across data lifecycle management, CICD, architecture design principles and cloud-native engineering.
- Provide mentoring, guidance and leadership to engineers across consulting engagements, setting the bar for delivery quality and engineering maturity.
- Identify opportunities for performance improvements, cost reduction, platform resilience and automation.
- Oversee the end-to-end development of data pipelines, ensuring reliability, observability and efficient operation.
Description
We are searching for an accomplished Lead Azure Databricks Engineer to join our consulting practice and take technical ownership of complex cloud data engineering projects across the Lloyds of London insurance market. This position is ideal for someone who is deeply hands-on, highly delivery-driven, and experienced in navigating the regulatory, operational and data challenges unique to the London Market. Our role offers a base salary of £78,000-£95,000 and a hybrid working model based in London, along with the opportunity to influence cloud engineering standards and contribute to major data transformation initiatives.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3001 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
The Scouts Association, Bluefruit Software Limited, SwapTix, Arctic Shores, Collect Solutions Ltd, NFU Mutual, Roke Manor Research Limited among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 94 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 94 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.