2591 IT & Software Developer jobs in the UK
Senior Data Engineer
£60,000 - 100,000
Rullion Limited
Cavendish Crescent South 23, Nottingham
£60,000 - 100,000
Requirements
Must:
- Extensive experience of Python preferred, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions.
- Strong understanding of SQL, database design, and data architecture.
- Experience with Databricks and/or Spark.
- Knowledgeable in data governance, data cataloguing, data quality principles, and related tools.
- Skilled in data extraction, joining, and aggregation tasks, especially with big data and real-time data using Spark.
- Capable of performing data cleansing operations to prepare data for analysis, including transforming data into useful formats.
- Understand data storage concepts and logical data structures, such as data warehousing.
- Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed.
- Can make data pipeline design recommendations based on business requirements.
- Experience with data migration is a plus.
- Open to new ways of working and new technologies.
- Self-motivated with the ability to set goals and take initiative.
- Driven to troubleshoot, deconstruct problems, and build effective solutions.
- Experience of Git / Version control.
- Experience working with larger, legacy codebases.
- Understanding of unit and integration testing.
- Understanding and experience with CI/CD and general software development best practices.
- A strong attention to detail and a curiosity about the data you will be working with.
- A strong understanding of Linux based tooling and concepts.
- Knowledge and experience of Amazon Web Services is essential.
Responsibilities
- Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change.
- Build and manage an enterprise data model within Databricks.
- Integrate new data sources into the platform using batch and streaming processes, adhering to SLAs.
- Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols.
- Ensure data quality and reliability processes are effective, maintaining trust in the data.
- Take ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements.
- Work closely with stakeholders and manage their requirements.
- Actively coach and mentor others in the team and foster a culture of innovation and peer review within the team to ensure best practice.
Description
We are embarking on an ambitious data transformation journey, guided by best practice data governance and architectural principles. As a major UK energy provider committed to 100% renewable energy and sustainability, we focus on delivering exceptional customer experiences. This is initially a 6-month contract with the potential for extension. The role is Hybrid and requires being based in our Nottingham office one day a week every two weeks, with some flexibility. Join us and be part of a dedicated team driving innovation in our industry.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2591 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Mas & Pas Limited, Bluefruit Software Limited, FCDO Services, SuperHiring, Renzo Talent, Access4, Pense Ltd among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 96 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 96 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.