Posted 4 days ago
No clicks
**Senior Data Engineer**: Designs, implements, and optimizes scalable data pipelines, ensuring compliance with data governance policies. Utilizes OO Python, ML libraries (Pandas, NumPy, Scikit-learn, TensorFlow), and emerging technologies like Apache Kafka and Drools. Applies statistics and econometrics techniques, using tools such as Splunk, Snowflake, and Aerospike. Employs Agile methodologies (Kanban, Scrum). Leads software testing, validation, and documentation. Bachelor's or Master's degree and 1-3 years of relevant experience required. Proven expertise in cloud-native, event-driven architectures using AWS, PySpark, Kafka, and Airflow. Develops data lakes, warehouses, and models, enabling cross-platform insights. ETL/ELT for predictive modeling and analytics. Automates data workflows and enables operational efficiency.
- Compensation
- Not specified
- City
- Not specified
- Country
- Not specified
Currency: Not specified
Full Job Description
Job Description:
Position Description:
Designs and implements scalable data pipelines, optimizes workflows for performance and reliability, and ensures compliance with data governance policies. Programs testable and maintainable software solutions using Object Oriented (OO) Python programming and Machine Learning (ML) libraries, including Pandas, NumPy, Scikit-learn, and TensorFlow. Develops and designs functional programming, emerging technologies, and messaging frameworks, using Kafka. Implements business rule management systems in Python or Java with Drools, Pyke, and Nools. Leverages quantitative, statistics, and econometrics (including probability, linear regression, time series data analysis, and optimizations) techniques and methods. Programs testable and maintainable software solutions using Splunk, Snowflake, YugabyteDB, Aerospike, and S3 database management systems. Employs Agile development lifecycle methodologies (Kanban and SCRUM).
Primary Responsibilities:
Develops software system testing and validation procedures, programming, and documentation.
Develops original and creative technical solutions to on-going development efforts.
Designs applications or subsystems on major projects and for/in multiple platforms.
Performs technical and functional analysis for data engineering projects.
Supports and performs all phases of testing leading to implementation.
Develops comprehensive documentation for multiple applications supporting several corporate initiatives.
Responsible for post-installation testing of any problems.
Establishes project plans for projects of moderate scope.
Works on complex assignments and often multiple phases of a project.
Collaborates with teams to support data-centric initiatives.
Performs independent and complex technical and functional analysis for multiple projects supporting several initiatives.
Education and Experience:
Bachelors degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Senior Data Engineer (or closely related occupation) architecting, building, deploying, and monitoring real-time and batch pipelines for data engineering in a financial services environment.
Or, alternatively, Masters degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and one (1) year of experience as a Senior Data Engineer (or closely related occupation) architecting, building, deploying, and monitoring real-time and batch pipelines for data engineering in a financial services environment.
Skills and Knowledge:
Candidate must also possess:
Demonstrated Expertise (DE) performing cloud-native, event-driven, data platform architecture using Amazon Web Services (AWS) (Lambda, Glue, EC2, EMR, Athena, and Crawler), PySpark, Kafka, and Airflow in enterprise environments.
DE building and optimizing data lakes, warehouses, and models, using Snowflake, Redshift, SQL, and Denodo to access federated databases (Oracle, DB2, Teradata, MongoDB, PostgreSQL, MSSQL, Yugabyte, and Aerospike); and enabling scalable transformations, performance tuning, and cross-platform insights.
DE developing Continuous Integration and Continuous Delivery (CI/CD) pipeline development and data workflow orchestration, using Airflow, Control-M, Jenkins, SQL, Python, Terraform, and Docker within the Software Development Life Cycle (SDLC), to automate ingestion, transformation, validation, and monitoring for data integrity, Agile delivery, and operational efficiency.
DE performing Extract Transform Load /Extract Load Transform (ETL/ELT) for predictive modeling and analytics, using Python, Pandas, Scikit-learn, TensorFlow, and Snowpark; generating insights using PowerBI, Tableau, or Quicksight; and developing scalable solutions using Java, Shell, PL/SQL, Talend, Alteryx, Informatica, Unix, and Linux.
#PE1M2
#LI-DNI
Certifications:
Category:
Information TechnologyPlease be advised that Fidelitys business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.
Apply
All fields are required.
Benefits that balance life and work
From our fully paid parent leave to our on-site health and wellness centers, our benefits support the belief that more balance you have, the better you can achieve your goals.
Company overview
Company overview
At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want. We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experience.
Reasonable accommodations
Fidelity will reasonably accommodate applicants with disabilities who need adjustments to participate in the application or interview process. To initiate a request for an accommodation contact the HR Accommodation Team by sending an email to accommodations@fmr.com, or by calling 800-835-5099, prompt 2, option 3.
Equal opportunity employer
Fidelity Investments is an equal opportunity employer. We believe that the most effective way to attract, develop, and retain a diverse workforce is to build an enduring culture of inclusion and belonging.
Applicant screening
At Fidelity, we value honesty, integrity, and the safety of our associates and customers within a heavily regulated industry. Certain roles may require candidates to go through a preliminary credit check during the screening process. Candidates who are presented with a Fidelity offer will need to go through a background investigation and may be asked to provide additional documentation as requested. This investigation includes but is not limited to a criminal, civil litigations and regulatory review, employment, education, and credit review (role dependent). These investigations will account for 7 years or more of history, depending on the role. Where permitted by federal or state law, Fidelity will also conduct a pre-employment drug screen, which will review for the following substances: Amphetamines, THC (marijuana), cocaine, opiates, phencyclidine.
AI Guidelines
Learn about our guidelines for use of AI when applying for a Fidelity job
