2337 IT & Software Developer jobs in the UK
Requirements
Must:
- Over 3 years of experience as a Data Engineer in Azure environments.
- Strong hands-on experience with Databricks, including PySpark, Delta Lake, cluster optimization, and job scheduling.
- Solid knowledge of Azure cloud services, including:
- Azure Data Lake Storage
- Azure Data Factory
- Azure Synapse / SQL Pools
- Azure Key Vault
- Proficient programming skills in Python and SQL.
- Experience building scalable, production-grade data pipelines.
- Understanding of data modeling, data warehousing concepts, and distributed computing.
- Familiarity with CI/CD, version control, and DevOps practices.
Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.
- Build and optimize data lakehouse architectures on Azure Data Lake Storage (ADLS).
- Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows.
- Implement best practices for data governance, security, and quality across all pipelines.
- Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models.
- Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimization.
- Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps.
Description
We are excited to welcome a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to our growing data engineering team. In this role, you will play a crucial part in designing, building, and optimizing scalable data pipelines and lakehouse architectures on Azure, ultimately enabling advanced analytics and data-driven decision-making throughout the business. Additionally, while not mandatory, it would be great if you have experience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka), knowledge of MLflow, Unity Catalog, or advanced Databricks features, exposure to Terraform or other Infrastructure as Code (IaC) tools, and experience working in Agile/Scrum environments. We pride ourselves on being a leading recruiter for Data & AI roles in the UK, offering more opportunities across the country than any other recruitment agency. We also proudly sponsor and support events like SQLBits, Power Platform World Tour, and the London Fabric User Group. Join us and elevate your career in Data & AI recruitment.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2337 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
ProCheckUp Limited, Deep Sea Electronics Ltd, LendingCrowd, razorblue Careers, Yorkshire Dental Suite, Internet Assist Limited, Expert Insights Tech Ltd among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 73 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 73 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.