Data Engineer - Belfast

- Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, utilizing Java, Python, Scala, Spark, and SQL. - Proficiency in tasks such as writing scripts, extracting data using APIs, and writing SQL queries. - Ability to collaborate closely with other engineering teams to integrate data engineering components into production systems. - Knowledge of data cleaning, wrangling, visualization, and reporting, along with an understanding of the most efficient use of associated tools and applications. - Capable of traveling to client sites when required. - Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources via ingestion and curation functions on AWS cloud, using either AWS native or custom programming. - Knowledge of data mining, machine learning, and natural language processing is an advantage. - Enjoy working within cross-functional Agile teams and familiar with Scrum ceremonies. - Comfortable designing and building for AWS cloud, with experience in architectures that include Platform-as-a-Service components and possibly server-less and container technologies. - Preferably experience with AWS tooling for ETL pipelines, data warehouse and data lake design/building, and data movement. Open-source equivalents will also be considered. - Experience working in teams to design, build, and maintain large scale data solutions and applications using AWS data and analytics services (or open-source equivalents), such as EMR, Glue, RedShift, Kinesis, Lambda, and DynamoDB. - Familiarity with defining the end-to-end software development lifecycle in alignment with modern AWS best practices, covering areas of data engineering, data science, and product development projects.