Posted 9 days ago
No clicks
**Principal Engineer - Python API Development** Drive ML at scale, designing and evolving platform capabilities. Leverage Python, distributed systems, and AWS services to deliver secure, cost-efficient, and widely-used solutions. Mentor engineers and lead cross-platform incident response. 8+ years of experience required. Fluency in Linux, expertise in Python and AWS.
- Compensation
- $107,000 – $216,000 USD
- City
- Not specified
- Country
- Not specified
Currency: $ (USD)
Full Job Description
Job Description:
Note: Fidelity will not provide immigration sponsorship for this position.
Principal Engineer - Python API Development
The Role:
As a Principal Engineer on the Enterprise AI/ML Platform team, you will tackle the most complex technical challenges involved in delivering machine learning at enterprise scale. You will design, build, and evolve reliable, secure, and costefficient platform capabilitiesfrom model packaging and serving to observability and lifecycle managementworking closely with multiple teams to ensure these capabilities are practical, robust, and widely usable in production.
You will take a handson role across enterprise repositories, improving shared services, CI/CD workflows, and infrastructure patterns where they have the greatest impact. This includes deep technical investigation of performance and scalability issues, such as tracking down bottlenecks in web services, analyzing system and application metrics, and optimizing GPU utilization, throughput, and resource efficiency across ML workloads.
The Expertise & Skills You Bring
Bachelors or Masters degree in Computer Science, Software Engineering, or a closely related engineering discipline; 8+ years (typically 10+) building and operating production platforms and services at scale.
Deep software engineering expertise in Python and distributed systems, with a track record of building productiongrade services, libraries, and internal platforms. You model engineering excellence through clean designs, automated testing, and maintainable abstractions; Linux fluency and scripting are required.
Familiarity with Java or Groovy is a plus.
Knowledge or experience with GenAI Gateways or LiteLLM a big plus.
Cloud platform leadership (AWS)handson with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQSand experience shaping platform patterns that other teams adopt. Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial.
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Gitbased workflows), containerization (Docker), release governance, and multienvironment promotion for MLenabled workloads.
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and postmortems) for ML serving and data/feature pipelines.
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible usewithout a research or modeling focus.
Crossorg technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes.
Set platform strategy and standards for ML packaging, deployment, serving, and observabilitydriving consistent adoption across squads and business units.
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production.
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services.
Advance model/data observabilitytooling for data and feature drift detection, predictionquality monitoring and uncertainty signals, and automated diagnostics/ explainability.
Lead crossplatform incident response and postmortems, drive systemic fixes, and evolve standards to prevent recurrenceacross applications and the platform.
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale.
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a longterm platform roadmap.
The Team
The Enterprise Data Science Platform, part of the Fidelity Data Architecture team within the Enterprise Technology business unit, is responsible for delivering scalable AI/ML capabilities across the organization. The team designs and builds advanced cloud-based, open-source, software platforms in close collaboration with Data Scientists, enabling the efficient packaging, deployment, and operation of AI/ML models at production scale.
In addition, the platform develops and maintains enterprise-grade gateways that allow teams across the company to securely discover, access, and consume AI/ML models. These gateways provide critical visibility into model usage and costs, while generating insights into model effectiveness, adoption patterns, and opportunities for continuous improvement.
The base salary range for this position is $107,000-216,000 USD per year.Placement in the range will vary based on job responsibilities and scope, geographic location, candidates relevant experience, and other factors.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.
We offer a wide range of benefits to meet your evolving needs and help you live your best life at work and at home. These benefits include comprehensive health care coverage and emotional well-being support, market-leading retirement, generous paid time off and parental leave, charitable giving employee match program, and educational assistance including student loan repayment, tuition reimbursement, and learning resources to develop your career. Note, the application window closes when the position is filled or unposted.
Please be advised that Fidelitys business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.
Most roles at Fidelity are Hybrid, requiring associates to work onsite every other week (all business days, M-F) in a Fidelity office. This does not apply to Remote or fully Onsite roles. Please consult with your recruiter for the specific expectations for this position.
Certifications:
Category:
Information TechnologyApply
All fields are required.
Benefits that balance life and work
From our fully paid parent leave to our on-site health and wellness centers, our benefits support the belief that more balance you have, the better you can achieve your goals.
Company overview
Company overview
At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want. We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experience.
Reasonable accommodations
Fidelity will reasonably accommodate applicants with disabilities who need adjustments to participate in the application or interview process. To initiate a request for an accommodation contact the HR Accommodation Team by sending an email to accommodations@fmr.com, or by calling 800-835-5099, prompt 2, option 3.
Equal opportunity employer
Fidelity Investments is an equal opportunity employer. We believe that the most effective way to attract, develop, and retain a diverse workforce is to build an enduring culture of inclusion and belonging.
Hybrid work schedule
Fidelitys hybrid working model blends the best of both onsite and offsite work experiences. Working onsite is important for our business strategy and our culture. We also value the benefits that working offsite offers associates. Most hybrid roles require associates to work onsite all business days of every other week in a Fidelity office.
Applicant screening
At Fidelity, we value honesty, integrity, and the safety of our associates and customers within a heavily regulated industry. Certain roles may require candidates to go through a preliminary credit check during the screening process. Candidates who are presented with a Fidelity offer will need to go through a background investigation and may be asked to provide additional documentation as requested. This investigation includes but is not limited to a criminal, civil litigations and regulatory review, employment, education, and credit review (role dependent). These investigations will account for 7 years or more of history, depending on the role. Where permitted by federal or state law, Fidelity will also conduct a pre-employment drug screen, which will review for the following substances: Amphetamines, THC (marijuana), cocaine, opiates, phencyclidine.
AI Guidelines
Learn about our guidelines for use of AI when applying for a Fidelity job
