2565 IT & Software Developer jobs in the UK
Senior Data Engineer - Azure Databricks
£124,800 - 128,160
Crimson
New Broad Street 46, South East London
£124,800 - 128,160
Requirements
Must:
We require a Senior Data Engineer with active SC Clearance for our esteemed global transformation consultancy based in London. It’s essential that you have hands-on experience in building and optimizing data pipelines, implementing data transformations, and ensuring data quality and reliability. You should possess a strong understanding of data engineering principles, big data technologies, and cloud computing, particularly with Azure.
Responsibilities
In this role, you will design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from various sources into Azure Databricks. You will optimize these pipelines for performance, reliability, and cost, while incorporating data quality checks. Additionally, you will develop complex transformations and processing logic using Spark (PySpark/Scala) to ensure accuracy and consistency across the data lifecycle.
Your responsibilities will also include integrating data from relational databases, APIs, and streaming sources, collaborating with API developers for seamless data exchange, and utilizing Azure Purview for governance and quality monitoring. Furthermore, you will partner with data scientists and technical teams to translate requirements into effective solutions, participate in code reviews, automate pipeline deployments, and promote best practices for automation.
Description
This position is hybrid, requiring 3 days per week on-site, and offers a competitive rate of up to £620 per day, inside IR35. We encourage you to join our agile team where your expertise can make a significant impact. If you're looking for a new opportunity to further your career in data engineering, we would love to hear from you!
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2565 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
ProCheckUp Limited, Yorkshire Dental Suite, Nexus Vehicle Rental, Autopeople Uk Limited, Internet Assist Limited, Central Technology Ltd, Street Group among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 83 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 83 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.