2354 IT & Software Developer jobs in the UK

Stott & May Professional Search Limited jobs

GenAI Data Engineer

£130,000 - 136,500
Stott & May Professional Search Limited
Charing Cross, South East London
£130,000 - 136,500
Company Size icon
Company Size
50-200
Company Type icon
Company Type
Services
Exp Level icon
Exp Level
Regular
Job Type icon
Job Type
Full-Time
Language icon
Language
English
Visa sponsorship icon
Visa sponsorship
No

Requirements

Must:
- Strong experience with PySpark and large-scale distributed data processing (ETL/ELT pipelines) - Advanced SQL expertise, including schema design (star/snowflake), indexing and optimisation techniques - Proven experience implementing CDC and SCD (Type 1/2/3) in data warehousing environments - Advanced Python skills for data engineering, automation and AI/ML integration - Hands-on experience with AWS services (e.g. S3, Glue, Lambda, EMR, Bedrock or custom model hosting) - Practical experience developing and evaluating GenAI/LLM models - Strong understanding of RAG architectures, embeddings and vector databases - Experience handling structured and unstructured data (e.g. text, documents, logs, images) - Knowledge of scalable storage solutions such as Delta Lake, Parquet, Redshift and DynamoDB - Experience optimising AI models (e.g. quantisation, distillation, inference tuning) - Strong troubleshooting and performance optimisation skills across distributed systems - Additional experience across PySpark, Python, SQL, AWS and GenAI technologies

Technologies

AI
Lambda
Redshift
LLM
PySpark

Responsibilities

- Design, build and maintain scalable data pipelines using PySpark, Python and distributed computing frameworks - Architect and optimise AWS-based data and AI infrastructure for secure, high-performance data processing - Develop, fine-tune, benchmark and evaluate GenAI/LLM models, including custom training and inference optimisation - Implement and maintain Retrieval-Augmented Generation (RAG) pipelines, vector databases and document processing workflows - Build reusable frameworks for prompt management, evaluation and GenAI operations - Collaborate with cross-functional teams to integrate GenAI solutions into production environments - Ensure data quality, governance and operational reliability across systems

Description


We are a forward-thinking team located in London and Edinburgh, delivering advanced data and AI solutions. We offer a hybrid work model, requiring only 2 days per week in the office. This is a 6-month contract role with a competitive market rate, designed for those looking to contribute to cutting-edge projects in a collaborative environment.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.

How many Data Engineer jobs are in the UK?

Currently, there are 2354 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.

Is the UK a good place for Data Engineers?

The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.

Which companies are hiring for Data Engineer jobs in the UK?

Yellowbrick Data, UKTL, Circuit Mind, Government Communications Headquarters (GCHQ), Point-of-Rental Software, ETL, Sage among others, are currently hiring for Data roles in the UK.

The company with most openings is Experis as they are hiring for 72 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.