2028 IT & Software Developer jobs in the UK
Lead Databricks Engineer
£85,000 - 85,000
Sanderson Recruitment
Eastway, Bournemouth
£85,000 - 85,000
Requirements
Must:
- Strong PySpark development skills for large-scale data engineering.
- Proven experience with Databricks pipelines and workflow management.
- Expertise in Azure Data Factory orchestration.
- Solid knowledge of Delta Lake and Lakehouse principles.
- Hands-on experience with SQL for data transformation.
- Familiarity with Azure services (ADLS/Blob, Key Vault, SQL).
- Knowledge of ETL/ELT frameworks and monitoring.
- Desirable: Understanding of Microsoft Fabric.
- Experience with DevOps practices (CI/CD).
- Awareness of data governance and lineage tools.
- Experience in Financial Services.
Responsibilities
- Build and maintain Databricks pipelines (batch and incremental) using PySpark and SQL.
- Orchestrate end-to-end workflows with Azure Data Factory.
- Develop and optimise Delta Lake tables (partitioning, schema evolution, vacuuming).
- Implement Medallion Architecture (Bronze, Silver, Gold) for transforming raw data into business-ready datasets.
- Apply robust monitoring, logging, and error-handling frameworks.
- Integrate pipelines with downstream systems such as Power BI.
- Collaborate with analysts, business teams, and engineers to deliver consistent, well-documented datasets.
- Support deployments and automation via Azure DevOps CI/CD.
- Gather and refine requirements from business stakeholders.
Description
We are offering a contract for a Lead Databricks Engineer in our Single Customer View (SCV) Programme, located in Bournemouth with hybrid working options. This role is a strategic initiative within Financial Services aimed at delivering a unified, trusted view of customer data. You will engage with cutting-edge technologies including Databricks, PySpark, and Azure Data Factory while applying best practices in data engineering and governance to support this critical programme. In addition to a competitive salary of £85,000, we provide numerous benefits including 30 days of holiday, a competitive pension scheme, an annual bonus scheme, private medical insurance, and more. Our commitment lies in building an inclusive culture and valuing diversity in all forms. We offer flexible working options, and while we cannot provide Skilled Worker Visa Sponsorship for this role, we are dedicated to supporting reasonable adjustments for candidates during the recruitment process. If you require assistance, please let us know when you apply or directly communicate with the recruiters.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2028 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Deep Sea Electronics Ltd, Together, Hyve Managed Hosting, razorblue Careers, KubeNet, Healthy Careers, MastarRec among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 72 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 72 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.