3496 IT & Software Developer jobs in the UK
Senior Data Engineer
£85,000 - 85,000
Low Carbon Contracts Company
Whitehall Quay 2, Holbeck
£85,000 - 85,000
Requirements
Must:
- Extensive experience in Cloud (preferably Microsoft Azure) Datawarehouse architecture as well as cloud data lakehouse platforms
- Experience of ETL and ELT processes, working with database architecture
- Able to develop and optimise coding in SQL and Python
- Experience in creating data pipelines using Cloud (preferably Azure Data Factory)
- Experience with Cloud: ADLS, Databricks, SQL DW, Serverless Architecture
- Experience in CI/CD pipelines and monitoring
- Able to work with large datasets and extrapolate conclusions
- Strong analytical and critical thinking abilities
- Highly desirable: Experience in building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructure
- Data Engineering experience in Microsoft stack
Responsibilities
- Own, design, develop and maintain our data platform ensuring reliable data across the organisation
- Drive better data governance through the creation and embedding of principles and processes
- Build and maintain key data governance and management artefacts e.g., Flow Diagram, Data Dictionary, KPI Catalogue
- Define overall approach and data flow for Extract, Transform and Load; and application of this for a given deployment/project
- Identify patterns, anomalies, and structure of data in preparation for Extract Transformation and Load
- Design and implement data pipelines and processes based on business requirements
- Write ETL data validation and data reconciliation queries
- Define high level and low-level design of a data platform to ensure robustness e.g., restorability, traceability, ease to support, etc.
- Define, embed, and drive data management and governance approaches, principles, and processes
- Identify data quality issues through data profiling, analysis, and stakeholder engagement
- Design and maintain the Microsoft Azure modern Datawarehouse architecture, implementation, administration, and support
- Translate complex business requirements into clear, scalable technical designs and delivery plans, ensuring alignment between stakeholder outcomes and engineering execution
Description
We are seeking a Senior Data Engineer for a permanent role located in Leeds city centre, offering a flexible working policy with a requirement to attend the office 2 days a week. In this role, you will focus on data and integration, ensuring reliable solutions to store and manage key data. You will enjoy a variety of employee benefits, including an annual performance-based bonus, generous annual leave, pension contributions, and professional development support. We are a committed team, striving to make a positive impact while fostering a collaborative environment.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3496 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
The Scouts Association, Bluefruit Software Limited, SwapTix, Arctic Shores, Adappt.ai, Government Communications Headquarters (GCHQ), MOD - Defence Digital among others, are currently hiring for Data roles in the UK.
The company with most openings is Hays Technology as they are hiring for 86 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Hays Technology as they are hiring for 86 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.