Posted 17 days ago
No clicks
The Fixed Income & Commodities Data team is seeking a Data Engineer to acquire, normalize, catalog, and make large datasets accessible. You will design and maintain data pipeline architecture, perform ETL using Python and SQL, and provide dataset access via REST and Python APIs. The role involves data cleansing and cataloging, communicating with business users and technology stakeholders, and supporting a fast-paced financial environment.
- Compensation
- $175,000 – $250,000 USD
- City
- New York City
- Country
- United States
Currency: $ (USD)
Full Job Description
The Fixed Income & Commodities Data team is looking for a Data Engineer that will work on the acquisition, accessibility, normalizing, and cataloging of large sets of data.
Responsibilities:
- Create and maintain optimal data pipeline architecture
- Extraction, transformation, and loading of data from a wide variety of data sources using Python and SQL
- Providing users access to datasets using REST and Python APIs
- Categorizing, cataloging, cleansing and normalizing of datasets
- Communicating with business users and technology stakeholders.
Required skills/experience:
- Bachelor’s degree in Computer Science or a related field
- 5+ years of professional experience with python data engineering
- Python and data analysis libraries (Pandas, NumPy, SciPy)
- Relational SQL database development
- Unix/Linux command-line experience
Desirable skills/experience:
- Object-oriented languages: Java, C++, etc.
- AWS cloud services: EC2, RDS, Athena, Lambda, etc.
- RDBMS: SQL Server and PostgreSQL
- Identity and Access Management: Kerberos, OAuth 2.0, LDAP
- Other: Apache HTTP Server, Kafka, Snowflake
- Broad understanding of fixed income, derivatives, futures, FX, or other financial-services instruments
Other Qualifications:
- Excellent listening, and communication (both oral and written) skills.
- Self-starter and critical thinker, takes ownership of own projects and makes improvement suggestions for the entire infrastructure.
- Proactive, assertive and attentive to details working independently and in a collaborative environment.
- Ability to handle several projects with different priorities at the same time in a fast-paced environment.
- Excellent self-management and problem-solving skills and a quick learner
The estimated base salary range for this position is $175,000 to $250,000, which is specific to New York and may change in the future. Millennium pays a total compensation package which includes a base salary, discretionary performance bonus, and a comprehensive benefits package. When finalizing an offer, we take into consideration an individual’s experience level and the qualifications they bring to the role to formulate a competitive total compensation package.
