LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
or continue with e-mail and password
Forgot password?
Don't have an account?
Create an account
or continue with e-mail and password
By signing up, you agree to our Terms & Conditions and Privacy Policy.

Data Platform Engineer

ExperiencedNo visa sponsorship
Capgemini logo

at Capgemini

Consultancies

Posted 2 days ago

No clicks

**Data Platform Engineer** designs, builds, and supports scalable, secure cloud-native data platforms on Microsoft Azure. Key responsibilities include automating infrastructure tasks using Linux, Python, and Shell scripting; managing Docker, Kubernetes (AKS); optimizing Apache Spark and Apache Iceberg; deploying CI/CD pipelines; ensuring secure platform access; and providing 24/7 production support. Requirements: Strong experience in cloud-native platforms on Azure, proficiency in Linux and scripting, solid experience with Docker and Kubernetes, familiarity with data platforms and DevOps. Preferred: Databricks, Gen AI, Agentic AI experience.

Compensation
Not specified

Currency: Not specified

City
Singapore
Country
Singapore

Full Job Description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired by a collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Job Description

Role Summary
We are seeking a Platform Engineer to design, build, and support scalable, secure, cloudnative data platforms on Microsoft Azure. The role involves strong handson work with Kubernetes, data platforms, automation, and DevOps, along with exposure to modern AIenabled ecosystems.

Key Responsibilities

  • Design, build, and maintain cloudnative data platforms
  • Automate infrastructure and operational tasks using Linux, Python, and Shell scripting
  • Build, manage, and optimize Docker images and containerized workloads
  • Deploy, operate, and troubleshoot workloads on Kubernetes (AKS or equivalent)
  • Support and optimize Apache Spark and Apache Icebergbased data platforms
  • Work with DataHub, Trino, and Apache Ranger for metadata, query, and governance use cases
  • Implement and maintain Azure CI/CD pipelines
  • Ensure secure platform access using TLS/SSL, OAuth, and HashiCorp Vault
  • Configure and manage Azure services including Blob Storage, Virtual Machines, VNETs, and AKS
  • Implement and manage NGINX Ingress Controllers and firewall rules
  • Monitor platforms using Prometheus and Grafana
  • Provide production support including troubleshooting, incident resolution, and performance tuning
  • Ensure adherence to enterprise change management and release processes

Required Skills and Experience

  • Strong experience with cloudnative platforms on Microsoft Azure
  • Handson expertise in Linux, Python, and Shell scripting
  • Solid experience with Docker and Kubernetes (AKS preferred)
  • Experience supporting Apache Spark workloads in production environments
  • Working knowledge of Iceberg, Trino, DataHub, and Ranger
  • Experience with Azure DevOps and CI/CD pipelines
  • Good understanding of platform security, identity, and secrets management
  • Experience with monitoring and observability tools

Preferred Skills

  • Experience with Databricks
  • Knowledge or experience in Generative AI (Gen AI) platforms
  • Exposure to Agentic AI concepts and architectures
  • Experience working in large enterprise or regulated environments

Soft Skills

  • Strong problemsolving and troubleshooting abilities
  • Ability to work effectively with crossfunctional teams
  • Good communication and documentation skills
  • Ownership mindset with a focus on reliability and continuous improvement

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.
Make it real | www.capgemini.com

Data Platform Engineer

Compensation

Not specified

City: Singapore

Country: Singapore

Capgemini logo
Consultancies

2 days ago

No clicks

at Capgemini

ExperiencedNo visa sponsorship

**Data Platform Engineer** designs, builds, and supports scalable, secure cloud-native data platforms on Microsoft Azure. Key responsibilities include automating infrastructure tasks using Linux, Python, and Shell scripting; managing Docker, Kubernetes (AKS); optimizing Apache Spark and Apache Iceberg; deploying CI/CD pipelines; ensuring secure platform access; and providing 24/7 production support. Requirements: Strong experience in cloud-native platforms on Azure, proficiency in Linux and scripting, solid experience with Docker and Kubernetes, familiarity with data platforms and DevOps. Preferred: Databricks, Gen AI, Agentic AI experience.

Full Job Description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired by a collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Job Description

Role Summary
We are seeking a Platform Engineer to design, build, and support scalable, secure, cloudnative data platforms on Microsoft Azure. The role involves strong handson work with Kubernetes, data platforms, automation, and DevOps, along with exposure to modern AIenabled ecosystems.

Key Responsibilities

  • Design, build, and maintain cloudnative data platforms
  • Automate infrastructure and operational tasks using Linux, Python, and Shell scripting
  • Build, manage, and optimize Docker images and containerized workloads
  • Deploy, operate, and troubleshoot workloads on Kubernetes (AKS or equivalent)
  • Support and optimize Apache Spark and Apache Icebergbased data platforms
  • Work with DataHub, Trino, and Apache Ranger for metadata, query, and governance use cases
  • Implement and maintain Azure CI/CD pipelines
  • Ensure secure platform access using TLS/SSL, OAuth, and HashiCorp Vault
  • Configure and manage Azure services including Blob Storage, Virtual Machines, VNETs, and AKS
  • Implement and manage NGINX Ingress Controllers and firewall rules
  • Monitor platforms using Prometheus and Grafana
  • Provide production support including troubleshooting, incident resolution, and performance tuning
  • Ensure adherence to enterprise change management and release processes

Required Skills and Experience

  • Strong experience with cloudnative platforms on Microsoft Azure
  • Handson expertise in Linux, Python, and Shell scripting
  • Solid experience with Docker and Kubernetes (AKS preferred)
  • Experience supporting Apache Spark workloads in production environments
  • Working knowledge of Iceberg, Trino, DataHub, and Ranger
  • Experience with Azure DevOps and CI/CD pipelines
  • Good understanding of platform security, identity, and secrets management
  • Experience with monitoring and observability tools

Preferred Skills

  • Experience with Databricks
  • Knowledge or experience in Generative AI (Gen AI) platforms
  • Exposure to Agentic AI concepts and architectures
  • Experience working in large enterprise or regulated environments

Soft Skills

  • Strong problemsolving and troubleshooting abilities
  • Ability to work effectively with crossfunctional teams
  • Good communication and documentation skills
  • Ownership mindset with a focus on reliability and continuous improvement

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.
Make it real | www.capgemini.com