Data Engineer

- Develop and maintain the councils Microsoft Azure Data Platform, supporting cloud-ready, scalable analytics. - Build and optimise data pipelines, APIs and integrations across on-premise, cloud and supplier-hosted systems. - Extract, clean, transform and combine data from a wide range of operational systems to create high-quality datasets for insight and machine learning. - Work with data scientists to design and maintain pipelines for AI/ML models, including supporting feature engineering, labelling and large-scale data flows. - Automate manual data processes to improve speed, reliability and accessibility of insight. - Lead data engineering projects, including working with external suppliers and supporting more junior colleagues. - Implement and maintain data lakehouse architectures, master data management and metadata repositories. - Ensure that data workflows comply with security, privacy and governance standards, including anonymisation where required. - Optimise the performance of code, pipelines and data systems, resolving issues, bugs and outages. - Contribute to the development of data strategy, standards and reusable engineering frameworks across the Hub. - Work with colleagues across ICT, Connected Places and service teams to join up data and support emerging technologies (e.g., IoT, geospatial, AI). - Support the creation of visualisations and reusable analytical products that enhance decision-making.