3004 IT & Software Developer jobs in the UK
Requirements
Must:
- Vast Data Engineering expertise with Big Data technologies.
- Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design.
- Hands-on experience configuring multi-node Hadoop clusters, including resource management, security, and performance tuning.
- Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools.
- Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB.
- Proven delivery of streaming pipelines and real-time data processing solutions.
- Improved job efficiency and reduced runtimes through Apache Spark optimisation and development.
- Some experience with containerisation (Docker, Kubernetes) and CI/CD pipelines.
- Experience replacing legacy ETL tools (e.g., Informatica) with modern data engineering pipelines and platform builds.
- Proven background working within financial services environments.
Responsibilities
- Design and deliver scalable on-prem, high-quality data solutions for various data platforms.
- Support a strategic metals initiative focused on reducing on-prem platform costs and modernising legacy ETL processes.
- Help design and build a new on-prem data platform aligned to the metals strategy.
- Develop and maintain scalable data pipelines and analytics infrastructure.
- Ensure data quality through automated validation, monitoring, and testing.
- Enable seamless integration across data warehouses and data lakes, contributing to a robust enterprise data ecosystem.
Description
We are a renowned financial services organization looking for a Senior Data Engineer to join our leading commodities, metals, trading, and exchange group. This hands-on role offers flexible working options and the chance to be part of a strategic initiative focused on modernizing our data practices. We focus on creating a dynamic and innovative team environment that supports professional growth and development.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3004 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Bluefruit Software Limited, Unum Group, EG Group, RevOps Automated, eonnext, Roots Plants, Leger Shearings Group among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 93 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 93 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.