LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
or continue with e-mail and password
Forgot password?
Don't have an account?
Join Canary Wharfian
or continue with e-mail and password
By signing up, you agree to our Terms & Conditions and Privacy Policy.

Data Engineer

ExperiencedNo visa sponsorship
Capgemini logo

at Capgemini

Consultancies

Posted 13 days ago

No clicks

**MID-LEVEL Data Engineer** at Capgemini Engineering designs, develops, and optimizes scalable data pipelines and analytics solutions using Databricks (Spark, Delta Lake). Experience required with Databricks, data replication (HVR), ETL/ELT processes, and cloud platforms (Azure, AWS, GCP). Collaborate with data scientists, integrate data from multiple sources, and ensure data quality and governance. Prioritize optimization, performance tuning, and security. Bachelor's degree in computer science and hands-on experience in data engineering or big data development.

Compensation
Not specified

Currency: Not specified

City
Not specified
Country
Not specified

Full Job Description

MID -Data Engineer- | REMOTE

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the worlds most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

We are seeking a skilled Databricks Engineer / Developer to design, develop and optimize scalable data pipelines and analytics solutions using the Databricks platform. The ideal candidate will have strong expertise in Python/Azure/Power BI, cloud data engineering and experience working in distributed data processing environments . This role involves the development and application of engineering practice and knowledge in defining, configuring and deploying industrial digital technologies (including but not limited to PLM and MES) for managing continuity of information across the engineering enterprise, including design, industrialization, manufacturing and supply chain, and for managing the manufacturing data.

YOUR ROLE

  • Design, develop, and support data replication and integration solutions using HVR

  • Design, build, and maintain scalable data pipelines using Databricks (Spark, Delta Lake)

  • Develop and optimize ETL/ELT processes for structured and unstructured data

  • Work with large datasets to ensure data quality, integrity, and performance optimization

  • Implement data models and transformations for analytics and reporting

  • Collaborate with data scientists and analysts to enable advanced analytics and ML workloads

  • Integrate data from multiple sources including databases, APIs, and streaming systems

  • Optimize Spark jobs for performance tuning and cost efficiency

  • Implement data governance, security, and access controls

  • Monitor and troubleshoot data pipelines and production issues

  • Support CI/CD pipelines and DevOps best practices for data engineering workflows

  • Support data migration and modernization initiatives.

  • Ensure data quality, governance, security, and compliance standards.

  • Create operational documentation, runbooks, and support procedures.

  • Participate in production support, issue resolution, and performance tuning activities.

YOUR PROFILE

  • Bachelors degree in computer science, Engineering, or related field
  • Technical Skills:
  • Hands-on experience with data engineering or big data development
  • Strong knowledge of:
  • SQL / Oracle / SQL Server
  • Java / JavaScript (preferred)
  • Web-based applications and APIs (REST/SOAP)
  • Strong experience with:
  • Databricks Platform
  • Apache Spark (PySpark/Scala)
  • SQL & Python
  • Experience with Delta Lake and data lake architecture
  • Hands-on experience with cloud platforms (Azure, AWS, or GCP)
  • Familiarity with data orchestration tools (Azure Data Factory, Airflow, etc.)
  • Knowledge of data warehousing concepts (Star schema, Snowflake schema)
  • Experience with version control (Git) and CI/CD pipelines
  • Strong understanding of data pipeline optimization and performance tuning

Tech Stack:

  • Databricks (Spark, Delta Lake)
  • Python / PySpark / SQL
  • Azure (ADLS, Synapse, ADF) / AWS (S3, Redshift, Glue)
  • Git, CI/CD tools
  • Data visualization tools (Power BI, Tableau)
  • Bachelors degree in computer science, Engineering, or related field
  • Technical Skills:
  • Hands-on experience with data engineering or big data development
  • Strong knowledge of:
  • SQL / Oracle / SQL Server
  • Java / JavaScript (preferred)
  • Web-based applications and APIs (REST/SOAP)
  • Strong experience with:
  • Databricks Platform
  • Apache Spark (PySpark/Scala)
  • SQL & Python
  • Experience with Delta Lake and data lake architecture
  • Hands-on experience with cloud platforms (Azure, AWS, or GCP)
  • Familiarity with data orchestration tools (Azure Data Factory, Airflow, etc.)
  • Knowledge of data warehousing concepts (Star schema, Snowflake schema)
  • Experience with version control (Git) and CI/CD pipelines
  • Strong understanding of data pipeline optimization and performance tuning

Tech Stack:

  • Databricks (Spark, Delta Lake)
  • Python / PySpark / SQL
  • Azure (ADLS, Synapse, ADF) / AWS (S3, Redshift, Glue)
  • Git, CI/CD tools
  • Data visualization tools (Power BI, Tableau)

WHAT YOULL LOVE ABOUT WORKING HERE?

  • At Capgemini Engineering, we encourage flexibility in how, when, and where people get their work done, allowing a better work-life balance, and greater empowerment. They partner with their managers to find an arrangement that works best for their role and their circumstances.
  • At Capgemini Engineering, were always looking ahead. Were part of a team that creates opportunities to achieve valuable change. Change that makes a difference. New connections, new technologies, new ways to work. Its so energizing.
  • At Capgemini Engineering, we make it easy for you to deepen knowledge and learn new skills while youre still doing the day job.

ABOUT CAPGEMINI

Data Engineer

Compensation

Not specified

City: Not specified

Country: Not specified

Capgemini logo
Consultancies

13 days ago

No clicks

at Capgemini

ExperiencedNo visa sponsorship

**MID-LEVEL Data Engineer** at Capgemini Engineering designs, develops, and optimizes scalable data pipelines and analytics solutions using Databricks (Spark, Delta Lake). Experience required with Databricks, data replication (HVR), ETL/ELT processes, and cloud platforms (Azure, AWS, GCP). Collaborate with data scientists, integrate data from multiple sources, and ensure data quality and governance. Prioritize optimization, performance tuning, and security. Bachelor's degree in computer science and hands-on experience in data engineering or big data development.

Full Job Description

MID -Data Engineer- | REMOTE

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the worlds most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

We are seeking a skilled Databricks Engineer / Developer to design, develop and optimize scalable data pipelines and analytics solutions using the Databricks platform. The ideal candidate will have strong expertise in Python/Azure/Power BI, cloud data engineering and experience working in distributed data processing environments . This role involves the development and application of engineering practice and knowledge in defining, configuring and deploying industrial digital technologies (including but not limited to PLM and MES) for managing continuity of information across the engineering enterprise, including design, industrialization, manufacturing and supply chain, and for managing the manufacturing data.

YOUR ROLE

  • Design, develop, and support data replication and integration solutions using HVR

  • Design, build, and maintain scalable data pipelines using Databricks (Spark, Delta Lake)

  • Develop and optimize ETL/ELT processes for structured and unstructured data

  • Work with large datasets to ensure data quality, integrity, and performance optimization

  • Implement data models and transformations for analytics and reporting

  • Collaborate with data scientists and analysts to enable advanced analytics and ML workloads

  • Integrate data from multiple sources including databases, APIs, and streaming systems

  • Optimize Spark jobs for performance tuning and cost efficiency

  • Implement data governance, security, and access controls

  • Monitor and troubleshoot data pipelines and production issues

  • Support CI/CD pipelines and DevOps best practices for data engineering workflows

  • Support data migration and modernization initiatives.

  • Ensure data quality, governance, security, and compliance standards.

  • Create operational documentation, runbooks, and support procedures.

  • Participate in production support, issue resolution, and performance tuning activities.

YOUR PROFILE

  • Bachelors degree in computer science, Engineering, or related field
  • Technical Skills:
  • Hands-on experience with data engineering or big data development
  • Strong knowledge of:
  • SQL / Oracle / SQL Server
  • Java / JavaScript (preferred)
  • Web-based applications and APIs (REST/SOAP)
  • Strong experience with:
  • Databricks Platform
  • Apache Spark (PySpark/Scala)
  • SQL & Python
  • Experience with Delta Lake and data lake architecture
  • Hands-on experience with cloud platforms (Azure, AWS, or GCP)
  • Familiarity with data orchestration tools (Azure Data Factory, Airflow, etc.)
  • Knowledge of data warehousing concepts (Star schema, Snowflake schema)
  • Experience with version control (Git) and CI/CD pipelines
  • Strong understanding of data pipeline optimization and performance tuning

Tech Stack:

  • Databricks (Spark, Delta Lake)
  • Python / PySpark / SQL
  • Azure (ADLS, Synapse, ADF) / AWS (S3, Redshift, Glue)
  • Git, CI/CD tools
  • Data visualization tools (Power BI, Tableau)
  • Bachelors degree in computer science, Engineering, or related field
  • Technical Skills:
  • Hands-on experience with data engineering or big data development
  • Strong knowledge of:
  • SQL / Oracle / SQL Server
  • Java / JavaScript (preferred)
  • Web-based applications and APIs (REST/SOAP)
  • Strong experience with:
  • Databricks Platform
  • Apache Spark (PySpark/Scala)
  • SQL & Python
  • Experience with Delta Lake and data lake architecture
  • Hands-on experience with cloud platforms (Azure, AWS, or GCP)
  • Familiarity with data orchestration tools (Azure Data Factory, Airflow, etc.)
  • Knowledge of data warehousing concepts (Star schema, Snowflake schema)
  • Experience with version control (Git) and CI/CD pipelines
  • Strong understanding of data pipeline optimization and performance tuning

Tech Stack:

  • Databricks (Spark, Delta Lake)
  • Python / PySpark / SQL
  • Azure (ADLS, Synapse, ADF) / AWS (S3, Redshift, Glue)
  • Git, CI/CD tools
  • Data visualization tools (Power BI, Tableau)

WHAT YOULL LOVE ABOUT WORKING HERE?

  • At Capgemini Engineering, we encourage flexibility in how, when, and where people get their work done, allowing a better work-life balance, and greater empowerment. They partner with their managers to find an arrangement that works best for their role and their circumstances.
  • At Capgemini Engineering, were always looking ahead. Were part of a team that creates opportunities to achieve valuable change. Change that makes a difference. New connections, new technologies, new ways to work. Its so energizing.
  • At Capgemini Engineering, we make it easy for you to deepen knowledge and learn new skills while youre still doing the day job.

ABOUT CAPGEMINI