2886 IT & Software Developer jobs in the UK
Senior Data Engineer - Bridgend
£55,000 - 62,000
Triton Street 20, Bridgend
£55,000 - 62,000
Requirements
Must:
- Expert-level SQL and Python (ideally PySpark).
- Strong understanding of DataSecOps; experience with PII handling, data obfuscation, and RBAC (Role-Based Access Control).
- Proven ability to design data systems (preferably Medallion architectures).
- Advanced knowledge of Power BI security and administration.
- Familiarity with git and gitflow version control processes.
- Knowledge of cloud cost and resource optimisation (FinOps principles).
- Awareness of agile delivery methodologies (Scrum or Kanban).
- Experience in building cloud-based data platforms, ideally on Azure.
- Delivered a Delta Lakehouse, Medallion Architecture, or similar curated data layering approach.
- Created end-to-end ELT/ETL pipelines using Databricks, Spark, Azure DataFactory, or equivalent tooling.
- Ensured data quality through validation, profiling, reconciliation, and automated tests.
- Provided guidance, reviewed code, coached junior team members, and influenced team practices.
- Desirable: Experience with DBT (Data Build Tool) or Prefect.
- Desirable: Knowledge of housing, asset management, or repairs systems (ideally Civica Cx and Total Mobile Service Connect).
Responsibilities
- Lead the design and implementation of a scalable and secure data platform using Azure Databricks, enabling the ingestion, transformation and governance of data from key business systems.
- Design and deploy secure, scalable ELT or ETL pipelines using Databricks (Unity Catalog), Delta Lake, and Azure Data Lake Storage (ADLS).
- Implement shift-left security principles within the data ingestion layer, including automated data masking and encryption.
- Establish and embed DataOps and DataSecOps practices, including CI/CD and automated security scanning of data pipelines.
- Finalise a governed Power BI architecture, including standardised semantic models and dataflows.
- Ensure robust Identity and Access Management (IAM) across Power BI workspaces.
- Proactively identify data and logic inconsistencies between systems and support stakeholders in resolving operational issues.
- Act as a technical lead, coaching a Junior Data Engineer and Analyst on modern engineering standards and secure coding practices.
- Work with the Software Engineering Manager to establish naming conventions and metadata standards.
- Constructively challenge stakeholders on scope and delivery to ensure deliverables remain on track.
- Support continuous improvement efforts through ongoing analysis and feedback, and implementation of best practices.
- Collaborate with housing and frontline teams to ensure system implementations improve service quality and accessibility for customers.
Description
We are a not-for-profit housing association located in Bridgend, Wales, established in 2003 with a mission to provide safe, high-quality, and affordable homes across Bridgend and South Wales. Our team is rooted in the commitment to create thriving communities where people feel secure, supported, and proud to live. We offer hybrid working options with two days a week in the office and focus on fostering a collaborative and innovative work environment.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the UK here.
How many Data Engineer jobs are in the UK?
Currently, there are 2886 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the UK a good place for Data Engineers?
The UK is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the UK?
The Scouts Association, Bluefruit Software Limited, SwapTix, Arctic Shores, NFU Mutual, MOD - Defence Digital, Wykes Engineering Co. (Rushden) Limited among others, are currently hiring for Data roles in the UK.
The company with most openings is Experis as they are hiring for 87 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.
The company with most openings is Experis as they are hiring for 87 different Data Engineer jobs in the UK. They are probably quite committed to find good Data Engineers.