LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
OR continue with e-mail and password
E-mail address
Password
Don't have an account?
Reset password
Join Canary Wharfian
OR continue with e-mail and password
E-mail address
Username
Password
Confirm Password
How did you hear about us?
By signing up, you agree to our Terms & Conditions and Privacy Policy.

Job Details

IMC Trading logo
Proprietary Trading

Data Engineer

at IMC Trading

ExperiencedNo visa sponsorship

Posted 17 days ago

No clicks

Join IMC's Data Platform team to operate, maintain and improve large-scale trading data systems that power analysis, simulation and reporting. You will manage distributed storage and processing platforms (HDFS, Kubernetes, Dremio, in-house pipelines), drive automation and CI/CD, and collaborate closely with systems engineers, traders and developers to troubleshoot and deploy solutions. The role requires hands-on Linux systems experience, familiarity with data technologies (Kafka, Spark, Cassandra/Scylla), container orchestration, and exposure to cloud platforms.

Compensation
Not specified

Currency: Not specified

City
Not specified
Country
United States, India

Full Job Description

Join our dynamic and high-impact Data Platform team, where you'll be responsible for safely receiving and storing trading-related data, as well as operating and improving our shared data access and data processing systems. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights. The ideal candidate should have work experience in systems engineering, preferably with prior exposure to financial markets and with proven working knowledge in the fields of Linux administration, orchestration and automation tools, systems hardware architecture as well as storage and data protection technologies.

Your Core Responsibilities:

  • Manage and monitor all distributed systems, storage infrastructure, and data processing platforms, including HDFS, Kubernetes, Dremio, and in-house data pipelines
  • Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions
  • Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries
  • Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions

Your Skills and Experience:

  • 2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role
  •  Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments
  • Experience in at least one of the following technologies: Kafka, Spark, Cassandra/Scylla, or HDFS
  • Working knowledge of Docker, Kubernetes, and Helm
  • Experience with data access technologies such as Dremio and Presto
  • Familiarity with workflow orchestration tools like Airflow and Prefect
  • Exposure to cloud platforms such as AWS, GCP, or Azure

About Us

IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.

 

Job Details

IMC Trading logo
Proprietary Trading

17 days ago

clicks

Data Engineer

at IMC Trading

ExperiencedNo visa sponsorship

Not specified

Currency not set

City: Not specified

Country: United States, India

Join IMC's Data Platform team to operate, maintain and improve large-scale trading data systems that power analysis, simulation and reporting. You will manage distributed storage and processing platforms (HDFS, Kubernetes, Dremio, in-house pipelines), drive automation and CI/CD, and collaborate closely with systems engineers, traders and developers to troubleshoot and deploy solutions. The role requires hands-on Linux systems experience, familiarity with data technologies (Kafka, Spark, Cassandra/Scylla), container orchestration, and exposure to cloud platforms.

Full Job Description

Join our dynamic and high-impact Data Platform team, where you'll be responsible for safely receiving and storing trading-related data, as well as operating and improving our shared data access and data processing systems. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights. The ideal candidate should have work experience in systems engineering, preferably with prior exposure to financial markets and with proven working knowledge in the fields of Linux administration, orchestration and automation tools, systems hardware architecture as well as storage and data protection technologies.

Your Core Responsibilities:

  • Manage and monitor all distributed systems, storage infrastructure, and data processing platforms, including HDFS, Kubernetes, Dremio, and in-house data pipelines
  • Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions
  • Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries
  • Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions

Your Skills and Experience:

  • 2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role
  •  Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments
  • Experience in at least one of the following technologies: Kafka, Spark, Cassandra/Scylla, or HDFS
  • Working knowledge of Docker, Kubernetes, and Helm
  • Experience with data access technologies such as Dremio and Presto
  • Familiarity with workflow orchestration tools like Airflow and Prefect
  • Exposure to cloud platforms such as AWS, GCP, or Azure

About Us

IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.