2299 IT & Software Developer jobs in the UK
Requirements
Must:
We are looking for a senior Data Engineer with the following mandatory skills:
- Deep experience with cloud platforms such as AWS (S3, Lambda, Glue, Redshift) and/or Azure (Data Lake, Synapse).
- Proficiency in programming and scripting languages like Python, SQL, and PySpark.
- Expertise in ETL/ELT and streaming technologies, including Apache Airflow, Glue, Kafka, Informatica, and EventBridge.
- Familiarity with industrial data integration from OT systems such as OSIsoft PI, SCADA, MES, and Historian.
- Experience in defining semantic layers, asset hierarchies, and contextual models through information modeling.
- Hands-on experience in data governance.
- Ability to implement data quality frameworks, including profiling, cleansing, standardization, and anomaly detection.
- Knowledge of data privacy, access control, and secure data exchange protocols.
- Experience in defining and creating MLOps pipelines.
Responsibilities
In this role, I will lead the development of intelligent, scalable data platforms for Industry 4.0 initiatives, focusing on:
- Architecting and implementing cloud-native data pipelines on AWS or Azure for ingesting, transforming, and storing industrial data.
- Integrating data from OT (SCADA, PLC, MES, Historian) and IT systems (ERP, CRM, LIMS) using protocols such as OPC UA, MQTT, and REST.
- Designing and managing data lakes, warehouses, and streaming platforms for predictive analytics, digital twins, and operational intelligence.
- Defining and maintaining asset hierarchies, semantic models, and metadata frameworks for contextualized industrial data.
- Implementing CI/CD pipelines for data workflows and ensuring lineage, observability, and compliance across environments.
- Collaborating with AI/ML teams to support model training, deployment, and monitoring using MLOps frameworks.
- Establishing and enforcing data governance policies, stewardship models, and metadata management practices.
- Monitoring and improving data quality using rule-based profiling, anomaly detection, and GenAI-powered automation.
- Supporting GenAI initiatives through data readiness, synthetic data generation, and prompt engineering.
Description
While the following skills are not mandatory, they would be beneficial: - Experience with Generative AI technologies, including LLMs, LangChain, HuggingFace, synthetic data generation, and prompt engineering. - Familiarity with digital twin integration, such as nVidia Omniverse, AWS TwinMaker, Azure Digital Twin, or similar platforms. - Proficiency in visualization tools like Power BI, Grafana, or custom dashboards for operational insights. - Knowledge of DevOps and automation tools, including CI/CD tools (Jenkins, GitHub Actions) and infrastructure-as-code (Terraform, CloudFormation). - Understanding of industry standards like ISA-95, Unified Namespace (UNS), FAIR data principles, and DataOps methodologies.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2299 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Mas & Pas Limited, Spiderweb systems, EG Group, Bank of England, Computershare, Accenture, Ever Nimble among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 95 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 95 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.