2885 IT & Software Developer jobs in the UK
Aws Data Engineer - Airflow
£24,000 - 24,000
Square One Resources
King Street West 31, Manchester
£24,000 - 24,000
Requirements
Must:
We are looking for a candidate with proven experience as an AWS DevOps Engineer or Data Engineer in complex cloud environments. You should have strong hands-on expertise with AWS services such as EC2, S3, Lambda, RDS, IAM, and CloudWatch. A demonstrated experience with Airflow (Astronomer) setup, orchestration, and optimization is essential. Additionally, proficiency in infrastructure as code (IaC) tools like Terraform or CloudFormation and experience with CI/CD pipelines and tools like Jenkins, GitHub Actions, or GitLab CI is required. A solid understanding of containerization technologies (Docker, Kubernetes), working knowledge of Python and SQL for automation and data pipeline development, and familiarity with monitoring and observability tools (Grafana, Prometheus, CloudWatch) are also important. Lastly, a strong grasp of data architecture principles and ETL design patterns is necessary, and experience in financial services or a regulated industry would be desirable.
Responsibilities
In this role, you will deploy and manage cloud infrastructure across Astronomer Airflow and AccelData environments. You will facilitate integration between vendor products and our core systems, which include data lakes, storage, and compute services. Establishing and enforcing best practices for cloud security, scalability, and performance will be one of your primary tasks. You will configure and maintain vendor product deployments to ensure reliability and optimized performance, while also ensuring high availability and fault tolerance for Airflow clusters. Your duties will include implementing and managing monitoring, alerting, and logging solutions for Airflow and related components, performing upgrades, patches, and version management for platform components, and overseeing capacity planning and resource optimization for Airflow workers and AWS resources. You will manage integrations with source control systems (GitHub, GitLab) and CI/CD pipelines, collaborate with AWS teams and internal stakeholders for pipeline scalability and optimization, and design and implement process improvements, including automation and infrastructure re-design. Additionally, you will develop ETL pipelines and data workflows using AWS and SQL technologies, partner with cross-functional teams (product, design, and leadership) to resolve technical issues, and enhance platform capabilities by building analytical tools and dashboards to leverage data pipelines for actionable business insights.
Description
This is an exciting opportunity available in the Manchester Area, requiring attendance in the office three days per week. The position is contract-based with a rate of up to £400 per day, falling inside IR35. The start date for this role is set for 03/11/2025, and the contract will last until 31st December 2025. We are eager to bring a talented individual onto our sector-leading financial services team, where you will play a pivotal role in advancing our data engineering function.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2885 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
Probado Ltd, Origin, Direct Online Services, Kura, RDC Aviation, Commsworld, BAE Systems among others, are currently hiring for Data roles in the UK.
The company with most openings is Hays Technology as they are hiring for 57 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Hays Technology as they are hiring for 57 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.