2354 IT & Software Developer jobs in the UK
Databricks SC Cleared Data Engineer
£42,000 - 72,500
IO Associates
Charing Cross, South East London
£42,000 - 72,500
Requirements
Must:
- Proven commercial experience as a Databricks Data Engineer
- Strong PySpark and SQL capability
- Hands-on delivery within AWS, Azure or GCP
- Experience with Delta Lake, data lakes and data warehouses
- Strong understanding of data modelling and scalable pipeline design
- Experience with Git, CI/CD and agile ways of working
- Active SC clearance (mandatory)
- Previous UK government or public sector contracts (desirable)
- Experience with Airflow, Azure Data Factory, AWS Glue or Kafka (desirable)
- Exposure to Snowflake or hybrid data architectures (desirable)
- Knowledge of secure, regulated data environments (desirable)
Responsibilities
- Design, build and maintain Databricks data pipelines using Apache Spark (PySpark & Spark SQL)
- Implement Delta Lake / Lakehouse architectures (Bronze, Silver, Gold)
- Develop scalable ELT/ETL workflows for batch and streaming data
- Optimise performance, reliability and cost across cloud data platforms
- Apply data quality, governance and security controls aligned to government standards
- Collaborate with architects, analysts and platform teams in an agile delivery environment
- Contribute to CI/CD pipelines and automated testing practices
Description
We are recruiting a contract Databricks Data Engineer for a large-scale UK Government programme delivering critical, cloud-native data platforms. This is a long-term engagement within a high-profile public sector transformation, working with sensitive, mission-critical data at national scale. You must already hold active SC clearance to be considered. We offer competitive market rates and a hybrid/remote working environment.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2354 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Yellowbrick Data, UKTL, Circuit Mind, Government Communications Headquarters (GCHQ), Point-of-Rental Software, ETL, Sage among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 72 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 72 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.