2231 IT & Software Developer jobs in the UK
Requirements
Must:
- 5 years of experience with Azure services (Azure Data Factory, ADLS, Azure SQL Database, Synapse Analytics)
- Strong hands-on expertise in Databricks, Delta Lake, and cluster management
- Proficiency in SQL and Python for pipeline development
- Familiarity with Git/GitHub and CI/CD practices
- Understanding of data modeling, data governance, and security principles
- Experience with Terraform or other Infrastructure-as-Code tools (desirable)
- Familiarity with Azure DevOps or similar CI/CD platforms (desirable)
- Experience with data quality frameworks and testing (desirable)
- Azure Data Engineer or Databricks certifications (desirable)
Responsibilities
- Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services
- Build ETL/ELT processes to transform raw data into structured, analytics-ready formats
- Optimise pipeline performance and ensure high availability of data services
- Architect and deploy scalable data lake solutions using Azure Data Lake Storage
- Implement governance and security measures across the platform
- Leverage Terraform or similar IaC tools for controlled and reproducible deployments
- Develop and optimise data jobs using PySpark or Scala within Databricks
- Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions
- Manage cluster configurations and CI/CD pipelines for Databricks deployments
- Implement monitoring solutions using Azure Monitor, Log Analytics, and Databricks tools
- Optimise performance, ensure SLAs are met, and establish disaster recovery and backup strategies
- Partner with data scientists, analysts, and business stakeholders to deliver effective solutions
- Document technical designs, data flows, and operational procedures for knowledge sharing
Description
We are a leading financial services company based in London, partnering with McCabe & Barton to find an experienced Data Platform Engineer. This is an excellent opportunity to join our forward-thinking team, focused on driving innovation with modern cloud-based data technologies. We offer a hybrid work environment (3 days in the office, 2 days WFH) and value collaboration and professional development.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2231 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Mas & Pas Limited, Bluefruit Software Limited, Roke Manor Research Limited, FCDO Services, Masters of Mystery, Phoenix Group, Access4 among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 101 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 101 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.