Job Title

Senior Manager / Architect GenAI Solutions

Role Overview

We are looking for a Senior Manager GenAI Architect with 14+ years of experience to own the endtoend solution architecture of enterprise GenAI platforms. This role is heavily focused on solution design, PoC & MVP creation, architectural decisionmaking, and production-grade implementation, while guiding teams and stakeholders from idea to scalable delivery.

You will act as the technical authority for GenAI, driving architectural excellence, evaluation strategies, and framework selection across enterprise use cases.

Key Responsibilities

• Own endtoend GenAI solution architecture, covering ideation, feasibility analysis, PoC execution, MVP design, and productionready implementation.
• Lead solution design and architecture workshops, translating complex business problems into scalable and secure GenAI architectures.
• Design, implement, and validate PoCs and MVPs to assess technical feasibility, architectural choices, cost-performance tradeoffs, and enterprise fit.
• Define and standardize enterprise GenAI reference architectures for chatbots, copilots, analytics assistants, and workflow automation use cases.
• Architect advanced RAG pipelines, including chunking strategies, retrieval methods, embedding optimization, reranking, and grounding techniques.
• Drive prompt engineering standards across solutions, including system prompt design, instruction tuning, reasoning control, and consistency guidelines.
• Define and govern prompt evaluation frameworks, covering correctness, faithfulness, hallucination reduction, determinism, latency, cost efficiency, and regression management.
• Lead architectural decisions around ChainofThought (CoT), structured reasoning, and explainability strategies.
• Architect and review agentic AI systems using LangChain, LangGraph, and custom orchestration layers, including multiagent coordination, tool usage, memory, routing, and fallback patterns.
• Own framework and technology evaluation, selecting appropriate GenAI frameworks based on scalability, reliability, observability, and enterprise constraints.
• Design scalable and secure FastAPIbased service architectures to expose GenAI capabilities across enterprise platforms.
• Define enterprise security architecture, including JWTbased authentication, authorization, data access controls, and LLM data protection.
• Lead AWS cloud architecture for GenAI workloads, ensuring scalability, reliability, cost optimization, and secure deployments.
• Architect and guide usage of DynamoDB, defining access patterns, performance optimization, and costefficient designs.
• Define vector database architecture, embedding lifecycle management, similarity tuning, and retrieval performance optimization.
• Own LLM platform and model strategy, including evaluation and usage of AWS Bedrock and Azure OpenAI based on cost, latency, security, compliance, and roadmap alignment.
• Establish LLMOps practices, including prompt versioning, model versioning, evaluation pipelines, deployment strategies, monitoring, rollback mechanisms, and operational governance.
• Design observability and evaluation strategies for GenAI systems, covering logging, tracing, prompt metrics, retrieval metrics, agent behavior, and cost monitoring.
• Define and enforce guardrails and responsible AI practices to minimize hallucinations, prevent data leakage, and ensure compliant and safe GenAI behavior.
• Review and guide engineering teams through architecture reviews, PoC signoffs, MVP readiness, and production certification.
• Mentor senior engineers, architects, and managers on GenAI architecture, system design, and enterprise delivery best practices.
• Act as a trusted technical advisor to leadership, providing clarity on feasibility, risks, timelines, and GenAI adoption strategy.

Mandatory Skills

• 14+ years of experience in software engineering, solution architecture, or AI platform design
• Strong expertise in Python ObjectOriented Programming
• Deep handson experience with RAG architectures, chunking strategies, retrieval optimization, CoT, and guardrails
• Advanced Prompt Engineering and prompt evaluation methodologies
• Strong experience with Agentic AI frameworks (LangChain, LangGraph)
• Expertise in FastAPI and APIled enterprise architecture
• Strong AWS architecture experience, including DynamoDB
• Secure system design using JWT authentication
• Deep understanding of vector databases and embedding optimization
• Handson experience with AWS Bedrock and Azure OpenAI
• Strong knowledge of LLMOps, including evaluation pipelines, deployment, monitoring, versioning, and governance of GenAI systems

Good to Have

• Experience with enterprise chatbot, copilot, or analyticsdriven GenAI platforms
• Exposure to complianceheavy or regulated enterprise environments
• Thought leadership in GenAI architecture, governance, or AI platform strategy

What we are looking for

• Strong architectural ownership with a builders mindset
• Proven ability to convert ambiguous ideas into working PoCs and MVPs
• Deep understanding of GenAI reliability, evaluation, and operationalization (LLMOps)
• Ability to balance innovation, cost, performance, and enterprise risk
• Strong stakeholder communication and technical influence
• Vision to scale GenAI solutions from experimentation to enterprise platforms