2780 IT & Software Developer jobs in the UK
Requirements
Must:
- Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data
- Hands-on experience with AWS Glue and AWS Step Functions
- Implementation of data validation, data quality frameworks, and reconciliation checks
- Strong error handling, monitoring, and retry strategies in production pipelines
- Experience with incremental data processing patterns (CDC, watermarking, upserts)
- Familiarity with AWS Data Services including Amazon S3, DynamoDB, Amazon Redshift, AWS Lambda, and Amazon EventBridge
- Strong understanding of vector database concepts, indexing strategies, and performance trade-offs
- Design and implementation of embedding generation pipelines
- Experience with CockroachDB deployment and management is beneficial
- Experience with PDF parsing libraries such as PyPDF2, pdfplumber, and AWS Textract
- Integration of OCR solutions for scanned documents
- Familiarity with SAP data structures is beneficial
- Advanced programming skills in Python (pandas, numpy, boto3) and SQL (complex queries, performance tuning)
- Data profiling and ongoing quality assessment
- Understanding of Master Data Management (MDM) concepts
- Knowledge of product catalog data models and e-commerce data patterns
Responsibilities
- Develop and maintain data pipeline architectures
- Ensure data quality through robust validation and monitoring
- Optimize data processing techniques and strategies
- Implement incremental data processing for efficiency
- Design data models and integrate various data structures
- Work with vector databases and enhance search accuracy
- Parse and process multiple document formats
- Collaborate with teams to integrate various data systems
- Ensure compliance with data governance standards
- Track data lineage and assess ongoing data quality
Description
We are a leading recruitment agency specializing in Data & AI roles across the UK. We offer more opportunities than any other agency in the region and take pride in our sponsorship and support of industry events such as SQLBits and the Power Platform World Tour. Our team is dedicated to connecting talented professionals with exciting roles in Data & AI, fostering growth and innovation in this dynamic field.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2780 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Bluefruit Software Limited, Mas & Pas Limited, LendingCrowd, KubeNet, Sellafield Ltd, Interface, Ctrl Alt among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 97 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 97 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.