3047 IT & Software Developer jobs in the UK
Requirements
Must:
- Strong hands-on experience with Kafka (producers/consumers, schema registry, Kafka Connect, KSQL/KStreams)
- Proficiency with OpenShift / Kubernetes telemetry, including OpenTelemetry and Prometheus
- Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM) and building dashboards and alerts
- Solid data engineering skills in Python (or similar) for ETL/ELT, enrichment, and validation
- Understanding of schema formats (Avro, Protobuf, JSON) and compatibility strategies
- Knowledge of observability standards and ability to drive toward proactive, automated monitoring capabilities
- Understanding of telemetry in hybrid cloud and multi-cluster environments
- Strong security awareness-secrets management, RBAC, encryption in transit/at rest
- Great communication skills and the ability to work effectively with cross-functional teams
- Applicants must be eligible for BPSS clearance (Baseline Personnel Security Standard)
Responsibilities
- Design, implement, and maintain scalable data pipelines to ingest and process telemetry (metrics, logs, traces) from OpenShift and Kubernetes platforms
- Stream telemetry via Kafka-managing producers, topics, schemas, and building resilient consumer services for transformation and enrichment
- Engineer multi-tenant observability data models and routing strategies, ensuring data lineage, quality, and SLAs
- Integrate processed telemetry into Splunk, enabling dashboards, alerting, analytics, and proactive insights (Level 4 Observability maturity)
- Implement schema governance, versioning, and compatibility controls using Avro/Protobuf
- Build automated validation, replay, and backfill tools to maintain data reliability and support recovery
- Instrument services with OpenTelemetry and drive consistency in tracing, metrics, and structured logging
- Use LLMs to enhance observability workflows-such as anomaly summarisation, query assistance, and automated runbook creation
- Work closely with platform, SRE, and application teams to integrate telemetry, alerts, and SLOs
- Ensure security, compliance, RBAC, and best practices across pipelines and tooling
- Produce clear documentation covering data flows, schemas, dashboards, and operational processes
Description
We are seeking a highly skilled Senior Data & Observability Engineer to design, build, and evolve large-scale telemetry and observability capabilities across modern cloud platforms. This role is based in Sheffield, requiring on-site presence 3 days a week, and is ideal for individuals who thrive in high-volume, real-time data environments and enjoy solving complex engineering challenges. Our team focuses on fostering innovation and proactive monitoring capabilities, ensuring security and compliance throughout our processes.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3047 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Openda Ltd, Bluefruit Software Limited, The Scouts Association, City of Lincoln Council, Mas & Pas Limited, DWP Digital, Wren among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 102 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 102 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.