Posted 3 days ago
No clicks
**Principal Data Engineer** Designs, develops, and maintains scalable data solutions in cloud environments. Builds automation pipelines using CI/CD tools like Jenkins, Stash, and Artifactory. Develops Oracle SQL and PL/SQL stored procedures, and creates web applications on Snowflake and AWS. Maintains reporting platforms and performs shell scripting using Python and Spark. Works in Agile environments, using Kanban and Scrum. Collaborates with analysts to create data profiles and rules using Informatica tools. Minimum of 5 years' experience as a Principal Data Engineer in financial services, or 3 years with a Master's degree, developing highly scalable BI and analytical solutions. Requires expertise in Oracle, AWS, Docker, Snowflake, Informatica, and CI/CD pipelines. Must have experience in Hadoop, Hive, Kafka, Spark, and Python for real-time Big Data solutions. Proficient in Test-Driven Development, performance testing, data profiling, and data mining.
- Compensation
- Not specified
- City
- Not specified
- Country
- Not specified
Currency: Not specified
Full Job Description
Job Description:
Position Description:
Builds automation pipelines using DevOps concepts and Continuous Integration and Continuous Delivery (CI/CD) tools -- Jenkins, Stash, Concourse, and Artifactory. Develops Oracle SQL and PL/SQL stored procedures for relational databases. Develops new web based applications within cloud environments Snowflake and Amazon Web Services (AWS). Designs, builds, and maintains reporting platforms. Writes codes with object-oriented programming languages -- Python/Spark. Performs shell scripting and scheduling using programming languages -- Python and Spark. Works in Agile environment executing projects using Kanban and SCRUM. Works with analysts to create profiles and rules for data quality using Informatica Data Quality IDQ tools and Address doctor.
Primary Responsibilities:
- Responsible for designing, developing, testing, deploying, maintaining and improving customer-facing software solutions.
- Performs test automation frameworks and standard methodologies to build a reliable product.
- Designs and builds Extract, Transact, and Load (ETL) solutions while incorporating TEST automation frameworks in highly scalable distributed data processing systems.
- Delivers software in an Agile environment.
- Develops and maintains databases using principles of Database Warehousing and Data mart concepts.
- Confers with systems analysts and other software engineers/developers to design systems and to obtain information on project limitations and capabilities, performance requirements, and interfaces.
- Develops and oversees software system testing and validation procedures, programming, and documentation.
Education and Experience:
Bachelors degree in Computer Science, Engineering, Information Technology, Information Systems or a closely related field (or foreign education equivalent) and five (5) years of experience as a Principal Data Engineer (or closely related occupation) designing and developing highly scalable Business Intelligence (BI) and analytical solutions in on-premise and Cloud platforms in a financial services environment using data warehouse and Data mart methodologies.
Or, alternatively, Masters degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Principal Data Engineer (or closely related occupation) designing and developing highly scalable Business Intelligence (BI) and analytical solutions in on-premise and Cloud platforms in a financial services environment using data warehouse and Data mart methodologies.
Skills and Knowledge:
Candidate must also possess:
- Demonstrated Expertise (DE) designing and developing data warehouse applications according to business user requirements, using AWS services, Docker Container, Snowflake, Informatica, Oracle, PL/SQL, and Control-M; maintaining Continuous Integration/Continuous Delivery (CI/CD) pipelines for application code using Jenkins, Jenkinscore, Terracore, bitbucket, Github, and Concourse; developing Unix shell scripts; and creating Control-M jobs to automate and schedule end-to-end processes.
- DE developing real time Big Data solutions on Hadoop, using Hive/Impala, Kafka, Scala, Spark SQL, and Python to build highly scalable and data availability platform to the end user.
- DE participating and implementing all aspects of the Software Development Lifecycle (SDLC) in delivering innovative solutions according to financial services standards, security requirements, software development best practices, and Agile methodologies; and utilizing Alation and Collibra to efficiently catalog, analyze and govern data assets, ensuring data quality, compliance and informed decision-making across the organization.
- DE performing Test-Driven Development (TDD), using JUnit; conducting performance testing using JMeter; Data profiling, and Data mining; troubleshooting issues using Datadog for Observability; and creating stable and highly available solutions, using Service Level Objectives (SLO) and Service Level Indicators (SLI) concepts.
#PE1M2
#LI-DNI
Certifications:
Category:
Information TechnologyPlease be advised that Fidelitys business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.
Apply
All fields are required.
Benefits that balance life and work
From our fully paid parent leave to our on-site health and wellness centers, our benefits support the belief that more balance you have, the better you can achieve your goals.
Company overview
Company overview
At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want. We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experience.
Reasonable accommodations
Fidelity will reasonably accommodate applicants with disabilities who need adjustments to participate in the application or interview process. To initiate a request for an accommodation contact the HR Accommodation Team by sending an email to accommodations@fmr.com, or by calling 800-835-5099, prompt 2, option 3.
Equal opportunity employer
Fidelity Investments is an equal opportunity employer. We believe that the most effective way to attract, develop, and retain a diverse workforce is to build an enduring culture of inclusion and belonging.
Applicant screening
At Fidelity, we value honesty, integrity, and the safety of our associates and customers within a heavily regulated industry. Certain roles may require candidates to go through a preliminary credit check during the screening process. Candidates who are presented with a Fidelity offer will need to go through a background investigation and may be asked to provide additional documentation as requested. This investigation includes but is not limited to a criminal, civil litigations and regulatory review, employment, education, and credit review (role dependent). These investigations will account for 7 years or more of history, depending on the role. Where permitted by federal or state law, Fidelity will also conduct a pre-employment drug screen, which will review for the following substances: Amphetamines, THC (marijuana), cocaine, opiates, phencyclidine.
AI Guidelines
Learn about our guidelines for use of AI when applying for a Fidelity job
