3982 IT & Software Developer jobs in the UK

Lorien jobs

Data Engineer - SC Clearance

£30,000 - 60,000
Bishopsgate 100, London
£30,000 - 60,000
Company Size icon
Company Size
200-500
Company Type icon
Company Type
Services
Exp Level icon
Exp Level
Senior
Job Type icon
Job Type
Full-Time
Language icon
Language
English
Visa sponsorship icon
Visa sponsorship
No

Requirements

Must:
- Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. - Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. - Proven experience in CI/CD practices using industry-standard tools (e.g., GitHub Actions, Azure DevOps). - Strong understanding of data architecture principles and cloud-native design patterns. - Demonstrated ability to lead technical delivery, mentor engineering teams, and collaborate with stakeholders to ensure alignment between data solutions and business strategy. - Proficiency in Linux/Unix environments and shell scripting. - Deep understanding of source control, testing strategies, and agile development practices. - Self-motivated with a strategic mindset and a passion for driving innovation in data engineering.

Technologies

Airflow
CI/CD
Databricks
GitHub
PySpark

Responsibilities

- Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. - Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. - Champion strong data quality, governance and observability practices. - Modernise legacy systems and support large-scale migrations into Azure. - Provide technical leadership, set engineering standards and contribute to architectural decisions. - Mentor engineers and foster a culture of continuous improvement. - Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs.

Description


We are a leading organisation within the UK financial sector embarking on a major data transformation programme. We are looking for an experienced Data Engineer for a 6-month contract to help design and deliver a modern, cloud-first data platform that will support some of our most critical functions. This is a hybrid role, requiring two days per week onsite. Please note that active SC Clearance is required for this role.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.

How many Data Engineer jobs are in the UK?

Currently, there are 3982 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.

Is the UK a good place for Data Engineers?

The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.

Which companies are hiring for Data Engineer jobs in the UK?

Arctic Shores, SwapTix, Element Materials Technology, HM Land Registry, Companies House, FCDO Services, TBG Solutions Ltd among others, are currently hiring for Data roles in the UK.

The company with most openings is Experis as they are hiring for 110 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.