at Capgemini
ConsultanciesPosted 2 days ago
No clicks
**Data Engineering Lead responsibilities:** Architect and implement modern, scalable data pipelines supporting batch, streaming, and real-time ingestion. Define data modeling best practices for analytical, AI, and retrieval-ready datasets. Build robust data quality frameworks. Drive performance optimization and establish strong data governance. Lead technical decision-making and mentor data engineering teams. Collaborate cross-functionally to deliver impactful data solutions and adopt new technologies. **Required skills and experience:** Proven leadership in enterprise-scale data engineering (9-13 years). Expertise in distributed data systems, ETL/ELT frameworks, and modern data architectures. Deep understanding of data modeling, transformation, and data quality. Strong performance tuning and cloud-based data platform proficiency (Azure, AWS, or GCP). Excellent communication skills and a collaborative leadership mindset.
- Compensation
- Not specified
- City
- Not specified
- Country
- India
Currency: Not specified
Full Job Description
Your Role
In this role, you will:
- Architect and implement modern, scalable data pipelines supporting batch, streaming, and real-time ingestion.
- Define and institutionalize data modeling best practices for analytical, AI, and retrieval-ready datasets.
- Build and enforce robust data quality frameworks ensuring high trust in data across systems.
- Drive performance optimization initiatives across ingestion, transformation, and storage layers.
- Establish strong data governance, access control, classification, and compliance mechanisms.
- Lead technical decision-making for large-scale data platform architecture.
- Mentor and grow a high-performing data engineering team, fostering engineering excellence and ownership.
- Collaborate cross-functionally with ML, RAG, MLOps, Security, and Product teams to deliver impactful data solutions.
- Continuously evaluate and adopt new technologies to improve data platform capabilities and efficiency.
Your Profile
- Proven experience leading data engineering teams in complex, enterprise-scale environments.
- Strong expertise in distributed data systems, ETL/ELT frameworks, and modern data architectures (lakehouse, medallion, etc.).
- Deep understanding of data modeling, schema design, and transformation patterns for analytics and AI.
- Hands-on experience with data quality frameworks, observability, and validation systems.
- Strong background in performance tuning, cost optimization, and system reliability engineering.
- Experience implementing data governance, security, and regulatory compliance practices.
- Proficiency in cloud-based data platforms (e.g., Azure, AWS, or GCP) and associated tooling.
- Excellent communication skills with the ability to influence technical and non-technical stakeholders.
- Strong leadership mindset with a focus on mentoring, collaboration, and continuous improvement.
What Youll Love About Working Here
- Opportunity to lead and shape next-generation data platforms powering AI and analytics at scale.
- Work on cutting-edge technologies including AI-ready data systems, RAG pipelines, and intelligent automation.
- Collaborative environment with highly skilled teams across data, AI, and product engineering.
- Strong focus on innovation, engineering excellence, and continuous learning.
- Flexible work culture that supports work-life balance and professional growth.
- Visibility and impact your work directly influences critical business decisions and AI capabilities.
