LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
or continue with e-mail and password
Forgot password?
Don't have an account?
Create an account
or continue with e-mail and password
By signing up, you agree to our Terms & Conditions and Privacy Policy.

Testing - AI Test Lead Senior

ExperiencedNo visa sponsorship
Ernst & Young logo

at Ernst & Young

Big Four

Posted 4 days ago

No clicks

**Testing - AI Test Lead Senior** Lead QA for AI, validate models (Narrow, Generative, Agentic) using testing strategies, collaborate with data scientists, manage teams. Expertise in AI/ML, testing tools, Python, cloud platforms. Agile experience essential.

Compensation
Not specified

Currency: Not specified

City
Not specified
Country
India

Full Job Description

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. 

 

 

 

 

Position Title:  QE AI Test Lead

 

About Global Delivery Services

 

Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EYs strategy by ensuring effective support to EYs growth agenda.

 

Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.

 

Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.

 

Enablement Services provides cost-effective, high-skilled, and innovative services to support EYs global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.

 

Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.

 

 

The Opportunity

 

As a QE AI Test Lead, you will be responsible for validating AI models and systems including Narrow AI, Generative AI, and Agentic AI. The role involves performing data validation, model evaluation, and statistical analysis while collaborating closely with data scientists to ensure comprehensive testing coverage.

 

You will also identify anomalies in data and outputs, assess model bias, and ensure that privacy and compliance protocols are strictly adhered to during testing activities.

 

 

Your Key Responsibilities

 

  • Define and own test strategy, planning, execution, and reporting for AI-based systems
  • Conduct AI model validation across functional, performance, and statistical metrics
  • Perform data validation activities including data collection, augmentation, exploratory analysis, bias detection, and privacy assessment
  • Identify discrepancies, anomalies, and risks in model outputs and ensure timely resolution with development teams
  • Lead defect management and collaborate with cross-functional teams for resolution
  • Engage with client stakeholders to provide status updates and resolve issues
  • Prepare test reports and support sign-off and closure activities
  • Lead distributed teams across geographies and ensure delivery excellence

 

 

Skills and attributes for success

 

  • Strong understanding of AI/ML concepts, LLMs, and Agentic AI systems
  • Hands-on experience in AI testing techniques such as bias testing, drift testing, metamorphic testing, and back-to-back testing
  • Expertise in test automation tools (e.g., Selenium, Playwright, PyTest)
  • Proficiency in Python programming and AI evaluation frameworks
  • Exposure to GitHub Copilot or similar AI-assisted development tools
  • Good understanding of cloud platforms such as Azure, AWS, or GCP
  • Strong analytical, problem-solving, and communication skills
  • Experience working in Agile environments

 

 

What we offer you

 

At EY, well develop you with future-focused skills and equip you with world-class experiences. Well empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. 

 

  • Our Commitment: As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.
  • Professional Development: From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.
  • People and Culture: In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equitable, fostering a sense of belonging. Our shared values include integrity, respect, teaming, inclusiveness, energy, enthusiasm, courage to lead, and building relationships based on doing the right thing.
  • Benefits: Embark on a transformative career journey with us and indulge in a suite of premium benefits, encompassing exclusive health and wellness packages, enticing rewards, and cutting-edge learning opportunities that empower you to continually grow and excel in your professional and personal development.
  • How to Apply: If you are passionate to join us and are aligned with our commitment to building a better working world, we invite you to apply by completing our user-friendly form with personal and professional information and by providing your consent to data privacy.

 

 

EY | Building a better working world 


 
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  


 
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  


 
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.  

Testing - AI Test Lead Senior

Compensation

Not specified

City: Not specified

Country: India

Ernst & Young logo
Big Four

4 days ago

No clicks

at Ernst & Young

ExperiencedNo visa sponsorship

**Testing - AI Test Lead Senior** Lead QA for AI, validate models (Narrow, Generative, Agentic) using testing strategies, collaborate with data scientists, manage teams. Expertise in AI/ML, testing tools, Python, cloud platforms. Agile experience essential.

Full Job Description

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. 

 

 

 

 

Position Title:  QE AI Test Lead

 

About Global Delivery Services

 

Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EYs strategy by ensuring effective support to EYs growth agenda.

 

Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.

 

Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.

 

Enablement Services provides cost-effective, high-skilled, and innovative services to support EYs global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.

 

Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.

 

 

The Opportunity

 

As a QE AI Test Lead, you will be responsible for validating AI models and systems including Narrow AI, Generative AI, and Agentic AI. The role involves performing data validation, model evaluation, and statistical analysis while collaborating closely with data scientists to ensure comprehensive testing coverage.

 

You will also identify anomalies in data and outputs, assess model bias, and ensure that privacy and compliance protocols are strictly adhered to during testing activities.

 

 

Your Key Responsibilities

 

  • Define and own test strategy, planning, execution, and reporting for AI-based systems
  • Conduct AI model validation across functional, performance, and statistical metrics
  • Perform data validation activities including data collection, augmentation, exploratory analysis, bias detection, and privacy assessment
  • Identify discrepancies, anomalies, and risks in model outputs and ensure timely resolution with development teams
  • Lead defect management and collaborate with cross-functional teams for resolution
  • Engage with client stakeholders to provide status updates and resolve issues
  • Prepare test reports and support sign-off and closure activities
  • Lead distributed teams across geographies and ensure delivery excellence

 

 

Skills and attributes for success

 

  • Strong understanding of AI/ML concepts, LLMs, and Agentic AI systems
  • Hands-on experience in AI testing techniques such as bias testing, drift testing, metamorphic testing, and back-to-back testing
  • Expertise in test automation tools (e.g., Selenium, Playwright, PyTest)
  • Proficiency in Python programming and AI evaluation frameworks
  • Exposure to GitHub Copilot or similar AI-assisted development tools
  • Good understanding of cloud platforms such as Azure, AWS, or GCP
  • Strong analytical, problem-solving, and communication skills
  • Experience working in Agile environments

 

 

What we offer you

 

At EY, well develop you with future-focused skills and equip you with world-class experiences. Well empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. 

 

  • Our Commitment: As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.
  • Professional Development: From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.
  • People and Culture: In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equitable, fostering a sense of belonging. Our shared values include integrity, respect, teaming, inclusiveness, energy, enthusiasm, courage to lead, and building relationships based on doing the right thing.
  • Benefits: Embark on a transformative career journey with us and indulge in a suite of premium benefits, encompassing exclusive health and wellness packages, enticing rewards, and cutting-edge learning opportunities that empower you to continually grow and excel in your professional and personal development.
  • How to Apply: If you are passionate to join us and are aligned with our commitment to building a better working world, we invite you to apply by completing our user-friendly form with personal and professional information and by providing your consent to data privacy.

 

 

EY | Building a better working world 


 
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  


 
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  


 
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.