2448 IT & Software Developer jobs in the UK
Databricks SME & AWS Data Engineer
£60,000 - 90,000
Queensbridge, Northampton
£60,000 - 90,000
Requirements
Must:
- Strong AWS Data Engineering expertise.
- Proficiency in Kafka for real-time data streaming and integration.
- Proficiency with Databricks for data processing and analytics.
- Working knowledge of NodeJS (added advantage).
- Solid programming skills in Python, PySpark, and Spark.
- Adept at working with large-scale datasets, S3, Python, and data cataloguing tools.
- Familiar with data engineering best practices.
- Demonstrates commitment to high-performance, scalable, and resilient distributed systems.
- Strong knowledge of CI/CD pipelines and tools (e.g., Jenkins, GitHub Actions, GitLab CI).
- Awareness of secure coding standards and data protection principles.
- Strong understanding of unit testing, integration testing, and test automation frameworks (e.g., PyTest).
- Familiarity with cloud-native development and CI/CD practices.
- Agile mindset with a proactive approach to problem-solving.
Responsibilities
- Collaborate with cross-functional teams to architect, design, develop, and deliver PoCs related to fraud detection.
- Lead the ETL & Data manipulation/engineering work on AWS.
- Integrate Databricks-based back-testing into the fraud detection pipeline.
- Work closely with architects and other developers to ensure seamless integration with existing systems.
- Participate in weekly stand-up calls to demonstrate progress and align on deliverables.
- Take ownership of tasks from the backlog, ensuring timely and high-quality delivery.
Description
We are seeking a Databricks SME and AWS Data Engineer for a 6-month project located in Northampton, UK, on a hybrid basis. This role involves migrating from Aerospike to Postgres and leveraging Databricks for back-testing fraud detection models. As part of our collaborative team, youll engage in cross-functional architecture and lead ETL efforts, focusing on high-quality delivery of Proof of Concepts (PoCs). We emphasize a supportive environment that values accountability and teamwork.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2448 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
City of Lincoln Council, Bluefruit Software Limited, Openda Ltd, National Highways, Flixmedia, Data Skill Source, TAG Support Services Limited among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 73 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 73 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.