Principal GCP Data Engineer

- Lead the design, development, and delivery of data processing solutions using GCP tools such as Dataflow, Dataproc, and BigQuery - Design automated data pipelines using orchestration tools like Cloud Composer - Contribute to architecture discussions and design end-to-end data solutions - Own development processes for your team, establishing robust principles and methods across architecture, code quality, and deployments - Shape team behaviours around specifications, acceptance criteria, sprint planning, and documentation - Define and evolve data engineering standards and practices across the organisation - Lead technical discussions with client stakeholders, achieving buy-in for solutions - Mentor and coach team members, building technical expertise and capability - Develop production-ready data pipelines and processing jobs using batch and streaming frameworks such as Apache Spark and Apache Beam - Apply expertise in data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes - Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions - Translate business requirements into technical specifications and actionable solution designs - Work with metadata management and data governance tools such as Cloud Data Catalog, Collibra, or Dataplex - Build data quality alerting and data quarantine solutions to ensure downstream reliability - Implement CI/CD pipelines with version control, automated tests, and automated deployments - Collaborate in Agile teams, using Scrum or Kanban methodologies