1677 IT & Software Developer jobs in the UK
Be among the first 5 applicants!
Senior Databricks Engineer
£60,000 - 80,000
Bibby Financial Services United Kingdom
Aynho Road, Adderbury
£60,000 - 80,000
Requirements
Must:
As our ideal Senior Databricks Engineer, we expect you to have significant years of experience with Databricks, including Unity Catalog. You should be proficient with Terraform for defining, deploying, and managing cloud infrastructure as code. Proficiency in programming languages such as Python, Spark, and SQL is essential, along with strong experience in SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF) and experience with cloud platforms (preferably Azure) and related data services are required. Excellent problem-solving skills, attention to detail, strong communication, and collaboration skills are a must. Familiarity with both Waterfall and Agile delivery methodologies is also an important asset.
Responsibilities
In the role of Senior Databricks Engineer, your responsibilities will include:
- Understanding the business/product strategy and supporting goals to ensure data interpretation aligns.
- Providing technical leadership on breaking down initiatives into appropriately sized features, epics, and stories that balance value and risk.
- Collaborating closely with the Data Architect to design our data architecture and translate it into a build plan.
- Leading the build and maintenance of scalable data pipelines and ETL processes that support data integration and analytics from a variety of data sources, including cloud storage, databases, and APIs.
- Delivering large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniques.
- Collaborating with the BI Product Owner, analysts, and other business stakeholders to grasp data requirements and deliver fitting solutions.
- Optimizing and tuning data processing systems for performance, reliability, and scalability.
- Implementing data quality and validation processes to ensure the accuracy and integrity of data throughout the pipelines.
- Operating in an agile CI/CD environment within Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices.
- Developing and maintaining data models, schemas, and documentation.
- Monitoring and troubleshooting data pipeline issues to ensure timely resolution.
- Staying updated with the latest industry trends and technologies in data engineering, recommending improvements to existing systems or processes.
- Ensuring adherence to BFS Governance processes.
- Providing line management and technical leadership to a small team of Data Engineers.
Description
We offer a competitive salary of £60,000 - £70,000 per annum and a comprehensive benefits package that includes private healthcare for you and your family, a company car allowance, a company pension scheme, and a wide range of flexible benefits such as gym memberships, technology, or health assessments. You will also have access to an online wellbeing center, a variety of discounts, 25 days of holiday (which increases with service), and options to buy or sell extra days off, along with an Electric Vehicle/Plug-in Hybrid Vehicle (EV/PHEV) scheme. At BFS, we have been supporting small and medium-sized enterprises (SMEs) since 1982 and take pride in assisting over 9,000 businesses worldwide today. Our work is centered around relationships, whether it's within our teams or with our clients. Our success comes from our talented people, and we thrive in a fast-paced, supportive environment where trust, ownership, flexibility, and fun are integral to our culture. We believe in empowering our colleagues, fostering growth, and celebrating achievements. With BFS, you will find a unique workplace that stands out and reflects our dedication to inclusivity, where everyone has equal opportunities to reach their full potential. If you're interested in joining us as our Senior Databricks Engineer, we encourage you to apply today; we would love to hear from you! This role will be hybrid and can be based in any of our UK offices. Please note that we are committed to inclusivity and are open to make adjustments during the recruitment process as needed. We reserve the right to close applications early and do not accept agency inquiries.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 1677 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Core-Asset Consulting, ApplianSys, u-blox, Serac Group, Mas & Pas Limited, Leidos, HM Land Registry among others, are currently hiring for Data roles in the UK.
The company with most openings is Ocho as they are hiring for 61 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Ocho as they are hiring for 61 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.