Pyspark Developer

In this role, you will be responsible for designing, building, and optimising data pipelines for both batch and streaming workloads. You will develop and manage data flows and semantic models to support analytics and reporting. Implementing complex data transformations, aggregations, and joins while focusing on performance and reliability will be a key part of your responsibilities. You will apply robust data validation, cleansing, and profiling techniques to maintain accuracy, enforce role-based access, and ensure compliance standards are met. Tuning and optimising workloads to minimise latency and enhance throughput, collaborating with analysts and stakeholders to translate business needs into technical solutions, and maintaining clear documentation while contributing to internal best practices will also be part of your duties.