2410 IT & Software Developer jobs in the UK
Data Engineer - City of London
£48,000 - 54,000
Guildhall Yard, City of London
£48,000 - 54,000
Requirements
Must:
###
- Proven experience with Databricks, PySpark, and Delta Lake.
- Strong understanding of workflow orchestration, performance optimization, and data governance.
- Hands-on experience with Azure cloud services.
- Ability to work in a fast-paced environment and deliver high-quality solutions.
- SC Cleared candidates are encouraged to apply.
###
Responsibilities
- Design, build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data.
- Optimize Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies.
- Conduct performance testing and cluster tuning to ensure cost-efficient, high-performing workloads.
- Implement data quality, lineage tracking, and access control policies aligned with Databricks Unity Catalogue and governance best practices.
- Develop PySpark applications for ETL, data transformation, and analytics, following modular and reusable design principles.
- Create and manage Delta Lake tables with ACID compliance, schema evolution, and time travel for versioned data management.
- Integrate Databricks solutions with Azure services such as Azure Data Lake Storage, Key Vault, and Azure Functions.
###
Description
We are seeking a Databricks Data Engineer who has strong expertise in designing and optimizing large-scale data engineering solutions within the Databricks Data Intelligence Platform. This role is ideal for individuals who are passionate about building high-performance data pipelines and ensuring robust data governance across modern cloud environments. If you’re interested in this role, we encourage you to apply now to send us your up-to-date CV. If this job isn't quite right for you, but you are looking for a new position, please reach out for a confidential discussion about your career.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2410 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
razorblue Careers, L A Comms Ltd, Novus - Strategy & Consulting, Tela Technology, MastarRec, Onca Technologies Ltd, PayItMonthly Ltd among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 90 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 90 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.