3034 IT & Software Developer jobs in the UK
Data Engineer
£45,000 - 65,000
Zonal Retail Data Systems Limited
Inverleith Row 1, Edinburgh
£45,000 - 65,000
Requirements
Must:
- Advanced programming knowledge of Python including the FastAPI Framework and Object Oriented Programming.
- Proven experience working with PySpark and Spark SQL for data transformation.
- Proven experience working with Azure cloud services specifically in Azure Data Factory, Storage, Service Bus and Azure Monitor or similar on AWS/GCP.
- Containerisation and orchestration using Docker and Kubernetes.
- Strong understanding of Databricks workflow orchestration, data validation patterns.
- Strong understanding of multi-tenant architecture and event-driven architecture.
- Experience with SQL database design and normalization.
- Hands-on experience with DevOps and CI/CD.
- Experience working with data visualization tools and techniques.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Ability to clearly document and communicate complex data concepts to a varied audience.
Bonus:
- Proven experience of Databricks especially around data ingest and pipelines.
- Experience in Data Science and Machine Learning models.
- Data Engineering certifications.
- Experience within hospitality, retail, payments or other guest facing systems.
- Excellent communication and stakeholder management.
- Degree in Computer Science, IT, or similar field; a Masters is a plus.
Responsibilities
- Create data pipeline architecture and RESTful API interfaces as part of a data solution.
- Design, build and maintain end-to-end data pipelines for multi-tenant data processing systems using Python, Databricks SDK and Databricks workflows.
- Design and maintain multi-tenant data processing systems.
- Integrate with Azure cloud services including Storage, Service Bus, Monitor, and Key Vault.
- Build and maintain Docker containers and manage applications on Kubernetes.
- Maintain Azure DevOps build and deployment pipelines for CI/CD.
- Manage data quality, monitor accuracy and completeness, and advise on improving data quality.
- Identify, perform root cause analysis, and fix incidents related to data management.
- Monitor performance of data and reporting platforms.
- Work as part of a team to deliver projects that meet business needs.
- Provide routine status updates to colleagues and stakeholder groups.
Description
We are the UKs leading tech developer for the biggest and best pubs and restaurants, offering comprehensive tech solutions that include EPoS, loyalty programs, CRM, table bookings, stock control, recipe management, and BI Reporting. We are seeking a passionate Data Engineer to join our team, contributing to a robust and accessible data foundation. Our work environment is hybrid remote, based in Edinburgh, with a competitive salary ranging from £45,000.00 to £65,000.00 per year, along with opportunities for personal and professional growth within a dynamic team.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 3034 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
The Scouts Association, Mas & Pas Limited, KubeNet, Ctrl Alt, Delapt Technologies UK, Companies House, OpenWorks Engineering among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 93 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 93 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.