
at Capgemini
ConsultanciesPosted 7 days ago
No clicks
**Senior Data Engineer - Vancouver** Leads team, drives projects. Requires Spark (PySpark) expertise, Azure data ingestion. Builds real-time, fault-tolerant pipelines. Tunes distributed queries, performs RCA. Needs senior-level experience and deep data engineering domain knowledge. Enhances team skills, fosters stakeholder collaboration.
- Compensation
- Not specified
- City
- Vancouver
- Country
- Canada
Currency: Not specified
Full Job Description
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired by a collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
- Strong/expert Spark (PySpark) Using Jupyter Notebooks, Colab or DataBricks (preferred)
- Hands-on data pipeline development, ingest patterns in Azure
- Orchestration tools, ADF or Airflow SQL Denormalized Data modeling for big data systems
Responsibilities and essential job functions include but are not limited to the following:
- Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities
- Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
- Provide consultation and lead the implementation of complex programs
- Develop and maintain documentation relating to all assigned systems and projects
- Tune queries running over billions of rows of data running in a distributed query engine
- Perform root cause analysis to identify permanent resolutions to software or business process issues
Job Description
Job Description - Grade Specific
Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.
Make it real | www.capgemini.com




