Data Engineer

Our Advanced Technology Centre is a hub of innovation where we deliver high‑quality data and technology services to clients across both the public and private sectors. You’ll join a collaborative culture that values diverse thinking, continuous learning, and opportunities for career growth within a global network of experts. If you’re looking for a dynamic role that offers hands‑on experience with modern data technologies and the chance to shape large‑scale data solutions, this position offers you the opportunity to develop and progress rapidly.

Role Overview As a Data Engineer, you will design, build, and maintain scalable data solutions that enable analytics, AI, and operational insights. You’ll work alongside client and internal teams to create robust data pipelines, ensure data reliability, and support cloud‑based architectures that power intelligent decision‑making. Key Responsibilities Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark.

Develop and support real‑time streaming pipelines and event‑driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Kinesis, MSK, Lambda, Glue). Contribute to data modelling, data architecture best practices, and modern patterns (e.g., medallion architecture).

Ensure data quality, lineage, governance, and security controls are applied consistently. DevOps & Deployment Deploy and maintain data applications using CI/CD tooling (Azure DevOps, GitHub Actions, Jenkins). Use Infrastructure as Code (e.g., Terraform, CloudFormation) to manage cloud environments.

Work with container technologies such as Docker and Kubernetes‑based workloads. Work closely with analytics, ML/AI, and product teams to deliver clean, well‑structured datasets. Participate in code reviews and internal knowledge‑sharing sessions.

Provide guidance to junior engineers where needed. #J-18808-Ljbffr