at Capgemini
ConsultanciesPosted 3 months ago
No clicks
Designing and developing end-to-end data pipelines using Azure Data Factory, Databricks, PySpark, SQL, and Delta Lake, including building and optimizing ETL workflows for ingestion, transformation, and loading into Azure Synapse Analytics and ADLS. Implementing data validation and quality frameworks to ensure data reliability, and writing efficient PySpark and SQL code for complex transformations and performance tuning. Managing secure access with Azure Key Vault, RBAC, and compliance best practices. Working in an Agile/Scrum environment delivering solutions aligned with business needs.
- Compensation
- Not specified
- City
- Mumbai
- Country
- India
Currency: Not specified
Full Job Description
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired by a collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Your Role
- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS.I
- Implementing data validation and quality frameworks to ensure data reliability. Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices
- Working in an Agile/Scrum environment, delivering solutions aligned with business needs.
Your Profile
- Should have 4 to 12 years of experience in Azure Databricks with strong pyspark experience
- Experience with Azure Data Bricks, Data Factory
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
- Experience in Python/Pyspark/Scala/Hive Programming.
- Experience with Azure Databricks/ADB
- Experience with building CI/CD pipelines in Data environments
What youll love about working here
- You can shape your career with us. We offer a range of career paths and internal opportunities within Capgemini group. You will also get personalized career guidance from our leaders.
- You will get comprehensive wellness benefits including health checks, telemedicine, insurance with top-ups, elder care, partner coverage or new parent support via flexible work.
- You will have the opportunity to learn on one of the industry's largest digital learning platforms, with access to 250,000+ courses and numerous certifications.
About Capgemini
Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion. Capgemini in India comprises nearly 235,000 team members working across 13 locations: Bangalore, Bhubaneswar, Chennai, Coimbatore, Gandhinagar, Gurugram, Hyderabad, Kolkata, Mumbai, Noida, Pune, Salem, and Tiruchirappalli.
Make it real | www.capgemini.com/in-en.
