LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
Forgot password?
Don't have an account?
or
Join Canary Wharfian
By signing up, you agree to our Terms & Conditions and Privacy Policy.
or

Conversational AI Specialist, Vice President

ExperiencedNo visa sponsorship
Morgan Stanley logo

at Morgan Stanley

Bulge Bracket Investment Banks

Posted a month ago

No clicks

**Conversational AI Specialist, Vice President** Drive enterprise-level conversational AI at Morgan Stanley. Develop and refine conversational experiences, prompts, and AI models. Collaborate cross-functionally to accelerate AI adoption. Bring strong conversation design, model evaluation, and prompt engineering skills. Manage risks and stakeholders. 9-12+ years' experience in conversational AI, project management, and leadership. Proficient in commercial or open-source LLMs, evaluation techniques. Minimum requirement: masters/PhD in CS/ML similar discipline.

Compensation
$110,000 – $140,000 USD

Currency: $ (USD)

City
New York City
Country
United States

Full Job Description

Position title: Conversational AI Specialist, VP

New York Plaza, NYC

COMPANY PROFILE

Morgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities, investment management and wealth management services. The Firm's employees serve clients worldwide including corporations, governments and individuals from more than 1,200 offices in 43 countries.

As a market leader, the talent and passion of our people is critical to our success. Together, we share a common set of values rooted in integrity, excellence, and strong team ethic. Morgan Stanley can provide a superior foundation for building a professional career - a place for people to learn, to achieve and grow. A philosophy that balances personal lifestyles, perspectives and needs is an important part of our culture.

About Firm wide AI

The Wealth Management Generative AI Team at Morgan Stanley is a dynamic and innovative department that serves as a Center of AI enablement. The team is responsible for deploying advanced systems that utilize generative artificial intelligence to optimize business processes. The team oversees governance and control measures to ensure the ethical and responsible use of AI technologies. The team is committed to fostering a culture of continuous learning and provide education on AI technologies to other departments within the company.

Position Overview:

We are seeking a highly skilled and motivated Conversational AI Specialist with a strong background in conversational design and model evaluation to join our team at Morgan Stanley. In this role, youll craft enterprise level conversational AI solutions, develop smart automation tools, and refine generative AI models to ensure reliable, quality outputs. This role will liaise with business teams across the Firm, technology, vendors, and centralized AI teams to accelerate the development and adoption of AI-based solutions.


Key Responsibilities:

  • Conversational Experiences: Develop and maintain differentiated conversational experiences for employee and client virtual assistant experiences that allow users to access knowledge, data and workflows.
  • Prompt Solutioning: Develop and refine context-aware prompts tailored to different use cases, domains, and user intents with a view of improving the accuracy, relevance and efficiency of AI generated chatbot responses. Ensure these prompt solutions are scalable, sustainable, effectively integrates with technical infrastructure, and successfully meet the specific needs of the business.
  • Testing and Evaluation: Develop and maintain data driven methodologies for testing and evaluating Generative AI responses for coherence, bias, factual accuracy and user satisfaction. Create and manage human evaluations manual and automated strategies such as LLM-as-a-judge to ensure LLM Model outputs meet high standards.
  • Troubleshooting and Optimization: Identify and troubleshoot issues and anomalies in the LLM model outputs and provide feedback and recommendations for solution improvement and optimization.
  • Risk Management: Identify potential risks and issues that may impact project delivery and develop mitigation strategies to address them proactively. Monitor project performance and implement corrective actions as necessary to ensure successful outcomes.
  • Stakeholder Management: Establish and maintain effective communication channels with internal stakeholders such as tech partners and business product owners. Manage expectations and address any concerns or issues that arise.
  • Collaboration: Collaborate with cross-functional teams, including internal stakeholders and vendor partners.
  • Performance Monitoring and Reporting: Track project performance metrics and KPIs to measure progress against objective and identify areas for improvement.

Qualifications/Skills Required or Preferred:

  • Experience with Conversational AI solutioning / product development / experimentation or Innovation.
  • Experience with prompt engineering for using Commercial or Open Source LLMs such as GPT, Claude, Gemini, LLAMA.
  • Experience with conversational AI evaluation techniques such as F1, RAGAS, and human feedback analysis.
  • Strong understanding of artificial intelligence concepts and technologies.
  • Excellent communication, interpersonal and leadership skills.
  • Proven experience in program or project management
  • Ability to manage multiple projects simultaneously in a fast-paced environment.
  • Solid analytical and problem-solving abilities with keen attention to detail

WHAT YOU CAN EXPECT FROM MORGAN STANLEY:

At Morgan Stanley, we raise, manage and allocate capital for our clients helping them reach their goals. We do it in a way thats differentiated and weve done that for 90 years. Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - arent just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, youll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. Theres also ample opportunity to move about the business for those who show passion and grit in their work.

To learn more about our offices across the globe, please copy and paste https://www.morganstanley.com/about-us/global-offices into your browser.

Expected base pay rates for the role will be between $110,000 and $140,000 per year at the commencement of employment. However, base pay if hired will be determined on an individualized basis and is only part of the total compensation package, which, depending on the position, may also include commission earnings, incentive compensation, discretionary bonuses, other short and long-term incentive packages, and other Morgan Stanley sponsored benefit programs.

Morgan Stanley is an equal opportunity employer committed to building and maintaining a workforce that is diverse in experience and background. Our recruiting efforts reflect our strong commitment to a culture of inclusion, where individuals are hired, developed, and advanced based on their skills and talents.

Our workforce reflects a broad cross-section of the global communities in which we operate, bringing a variety of backgrounds, talents, perspectives, and experiences.

For more information, please visit: https://www.morganstanley.com/people-opportunities/eeo.

Conversational AI Specialist, Vice President

Compensation

$110,000 – $140,000 USD

City: New York City

Country: United States

Morgan Stanley logo
Bulge Bracket Investment Banks

a month ago

No clicks

at Morgan Stanley

ExperiencedNo visa sponsorship

**Conversational AI Specialist, Vice President** Drive enterprise-level conversational AI at Morgan Stanley. Develop and refine conversational experiences, prompts, and AI models. Collaborate cross-functionally to accelerate AI adoption. Bring strong conversation design, model evaluation, and prompt engineering skills. Manage risks and stakeholders. 9-12+ years' experience in conversational AI, project management, and leadership. Proficient in commercial or open-source LLMs, evaluation techniques. Minimum requirement: masters/PhD in CS/ML similar discipline.

Full Job Description

Position title: Conversational AI Specialist, VP

New York Plaza, NYC

COMPANY PROFILE

Morgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities, investment management and wealth management services. The Firm's employees serve clients worldwide including corporations, governments and individuals from more than 1,200 offices in 43 countries.

As a market leader, the talent and passion of our people is critical to our success. Together, we share a common set of values rooted in integrity, excellence, and strong team ethic. Morgan Stanley can provide a superior foundation for building a professional career - a place for people to learn, to achieve and grow. A philosophy that balances personal lifestyles, perspectives and needs is an important part of our culture.

About Firm wide AI

The Wealth Management Generative AI Team at Morgan Stanley is a dynamic and innovative department that serves as a Center of AI enablement. The team is responsible for deploying advanced systems that utilize generative artificial intelligence to optimize business processes. The team oversees governance and control measures to ensure the ethical and responsible use of AI technologies. The team is committed to fostering a culture of continuous learning and provide education on AI technologies to other departments within the company.

Position Overview:

We are seeking a highly skilled and motivated Conversational AI Specialist with a strong background in conversational design and model evaluation to join our team at Morgan Stanley. In this role, youll craft enterprise level conversational AI solutions, develop smart automation tools, and refine generative AI models to ensure reliable, quality outputs. This role will liaise with business teams across the Firm, technology, vendors, and centralized AI teams to accelerate the development and adoption of AI-based solutions.


Key Responsibilities:

  • Conversational Experiences: Develop and maintain differentiated conversational experiences for employee and client virtual assistant experiences that allow users to access knowledge, data and workflows.
  • Prompt Solutioning: Develop and refine context-aware prompts tailored to different use cases, domains, and user intents with a view of improving the accuracy, relevance and efficiency of AI generated chatbot responses. Ensure these prompt solutions are scalable, sustainable, effectively integrates with technical infrastructure, and successfully meet the specific needs of the business.
  • Testing and Evaluation: Develop and maintain data driven methodologies for testing and evaluating Generative AI responses for coherence, bias, factual accuracy and user satisfaction. Create and manage human evaluations manual and automated strategies such as LLM-as-a-judge to ensure LLM Model outputs meet high standards.
  • Troubleshooting and Optimization: Identify and troubleshoot issues and anomalies in the LLM model outputs and provide feedback and recommendations for solution improvement and optimization.
  • Risk Management: Identify potential risks and issues that may impact project delivery and develop mitigation strategies to address them proactively. Monitor project performance and implement corrective actions as necessary to ensure successful outcomes.
  • Stakeholder Management: Establish and maintain effective communication channels with internal stakeholders such as tech partners and business product owners. Manage expectations and address any concerns or issues that arise.
  • Collaboration: Collaborate with cross-functional teams, including internal stakeholders and vendor partners.
  • Performance Monitoring and Reporting: Track project performance metrics and KPIs to measure progress against objective and identify areas for improvement.

Qualifications/Skills Required or Preferred:

  • Experience with Conversational AI solutioning / product development / experimentation or Innovation.
  • Experience with prompt engineering for using Commercial or Open Source LLMs such as GPT, Claude, Gemini, LLAMA.
  • Experience with conversational AI evaluation techniques such as F1, RAGAS, and human feedback analysis.
  • Strong understanding of artificial intelligence concepts and technologies.
  • Excellent communication, interpersonal and leadership skills.
  • Proven experience in program or project management
  • Ability to manage multiple projects simultaneously in a fast-paced environment.
  • Solid analytical and problem-solving abilities with keen attention to detail

WHAT YOU CAN EXPECT FROM MORGAN STANLEY:

At Morgan Stanley, we raise, manage and allocate capital for our clients helping them reach their goals. We do it in a way thats differentiated and weve done that for 90 years. Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - arent just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, youll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. Theres also ample opportunity to move about the business for those who show passion and grit in their work.

To learn more about our offices across the globe, please copy and paste https://www.morganstanley.com/about-us/global-offices into your browser.

Expected base pay rates for the role will be between $110,000 and $140,000 per year at the commencement of employment. However, base pay if hired will be determined on an individualized basis and is only part of the total compensation package, which, depending on the position, may also include commission earnings, incentive compensation, discretionary bonuses, other short and long-term incentive packages, and other Morgan Stanley sponsored benefit programs.

Morgan Stanley is an equal opportunity employer committed to building and maintaining a workforce that is diverse in experience and background. Our recruiting efforts reflect our strong commitment to a culture of inclusion, where individuals are hired, developed, and advanced based on their skills and talents.

Our workforce reflects a broad cross-section of the global communities in which we operate, bringing a variety of backgrounds, talents, perspectives, and experiences.

For more information, please visit: https://www.morganstanley.com/people-opportunities/eeo.