3072 IT & Software Developer jobs in the UK
Requirements
Must:
- Azure mastery: Deep expertise in the Azure Ecosystem, specifically Databricks, Azure Data Factory (ADF), Synapse and Unity Catalog.
- Data engineering: Proficiency in Python, PySpark and Spark SQL for ETL/ELT pipeline development.
- Time-series expertise: Proven experience handling real-time, high frequency data feeds (e.g. aviation, sensor or industrial data).
- Schema design: Advanced knowledge of Star and Snowflake Schemas and Lakehouse architectures.
- Quality assurance: Hands-on experience with data validation tools like Great Expectations and observability platforms like Grafana.
- DevOps: Familiarity with CI/CD processes using Azure DevOps or GitHub Actions.
- 6+ years of experience in data engineering with a focus on resilient, high availability systems (preferred).
- Strong understanding of security protocols, including RBAC and Row-level Masking (preferred).
- Ability to work closely with AI/ML teams to support predictive maintenance or digital data products (preferred).
Responsibilities
- Data architecture & modelling: Design and implement a scalable architecture on Microsoft Azure to organise raw system data into curated, reporting-ready layers.
- Operational system integration: Build robust pipelines to ingest and process high-frequency time-series and IoT-like data from critical infrastructure.
- Cloud database production: Develop and manage the foundational cloud database using Azure Databricks, Synapse and Data Lake to serve as the single source of truth.
- Real-time processing: Implement and optimise streaming workloads using Kafka, Event Hub and Spark Streaming to ensure low-latency data availability for life-critical monitoring.
- Governance & compliance: Enforce strict data quality frameworks and maintain PII/PHI compliance, ensuring the integrity of sensitive healthcare and operational data.
- Visualisation & reporting: Collaborate with stakeholders to design and deploy the Master Dashboard using Power BI, utilising DAX and semantic models for actionable insights.
Description
At OKTO, we are seeking a Senior Data Engineer to lead the architecture and implementation of a critical digital operations system. This role is essential to our mission of integrating various system endpoints into a centralized, resilient cloud-based infrastructure. We pride ourselves on investing significantly in personal development and ongoing training for our employees. Our permanent team members enjoy substantial benefits including a company pension, a cycle to work scheme, paid volunteer time, private medical insurance, and opportunities for professional growth. We are located in Lisburn and are proud to employ a highly skilled technical team dedicated to excellence.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3072 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
The Scouts Association, Mas & Pas Limited, Companies House, Addooco IT Limited, Hillside Primary Care IT Services, Delapt Technologies UK, OpenWorks Engineering among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 93 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 93 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.