LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
Forgot password?
Don't have an account?
or
Join Canary Wharfian
By signing up, you agree to our Terms & Conditions and Privacy Policy.
or

IBM Datastage, Pyspark, Control-M/Consultant Specialist

ExperiencedNo visa sponsorship
HSBC logo

at HSBC

Other

Posted 6 days ago

No clicks

**IBM Datastage, Pyspark, Control-M/Consultant Specialist** Design, build, and maintain ETL data pipelines using IBM DataStage. Optimize large-scale data processing with PySpark. Create and support batch scheduling using Control-M. Work confidently in Linux/Unix environments. Requires demonstrable delivery of data engineering solutions and strong hands-on capabilities with respective technologies. A bankingcontext experience is a plus.

Compensation
Not specified

Currency: Not specified

City
Not specified
Country
India

Full Job Description

Some careers shine brighter than others.

If youre looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist

In this role, you will:

  • Design, build, and maintain extract, transform, load (ETL) data pipelines using IBM DataStage to ingest, transform, and load data from multiple sources.
  • Develop and optimise large-scale data processing using Python Spark (PySpark), including performance tuning and partitioning approaches.
  • Create and support batch scheduling and workload automation using ControlM, including job flows, dependencies, calendars, alerting, and restartability.
  • Work confidently in Linux/Unix environments, using scripting for automation and troubleshooting, and managing files, permissions, and process monitoring.
  • Investigate production issues, carry out root-cause analysis, and implement fixes with a focus on stability, resilience, and repeatable operations.
  • Collaborate with upstream and downstream colleagues (for example, data producers, data consumers, quality assurance, platform, and operations) to deliver reliable data products.
  • Ensure solutions meet financial services expectations for data quality, auditability, data lineage, and operational controls.
  • Produce clear technical documentation such as data mappings, job designs, runbooks, and operational procedures.

To be successful in this role, you should meet the following requirements:

  • Demonstrable experience delivering data engineering and/or data integration solutions in a production environment.
  • Strong hands-on capability with IBM DataStage (job design, parallelism, performance tuning, and error handling).
  • Strong hands-on capability with PySpark (DataFrames, transformations and actions, and optimisation techniques).
  • Strong hands-on capability with ControlM (scheduling, monitoring, incident handling, and job orchestration).
  • Working knowledge of Linux/Unix, including shell scripting and environment troubleshooting.
  • Experience in a banking or financial services context (for example, risk, finance reporting, payments, antimoney laundering (AML), regulatory reporting, treasury, or customer data).
  • Experience supporting live services, including on-call and incident processes, and working to service level agreements (SLAs).
  • Strong analytical and problem-solving skills, with the ability to communicate clearly with both technical and non-technical stakeholders.

Youll achieve more when you join HSBC.

www.hsbc.com/careers

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by HSBC Software Development India

IBM Datastage, Pyspark, Control-M/Consultant Specialist

Compensation

Not specified

City: Not specified

Country: India

HSBC logo
Other

6 days ago

No clicks

at HSBC

ExperiencedNo visa sponsorship

**IBM Datastage, Pyspark, Control-M/Consultant Specialist** Design, build, and maintain ETL data pipelines using IBM DataStage. Optimize large-scale data processing with PySpark. Create and support batch scheduling using Control-M. Work confidently in Linux/Unix environments. Requires demonstrable delivery of data engineering solutions and strong hands-on capabilities with respective technologies. A bankingcontext experience is a plus.

Full Job Description

Some careers shine brighter than others.

If youre looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist

In this role, you will:

  • Design, build, and maintain extract, transform, load (ETL) data pipelines using IBM DataStage to ingest, transform, and load data from multiple sources.
  • Develop and optimise large-scale data processing using Python Spark (PySpark), including performance tuning and partitioning approaches.
  • Create and support batch scheduling and workload automation using ControlM, including job flows, dependencies, calendars, alerting, and restartability.
  • Work confidently in Linux/Unix environments, using scripting for automation and troubleshooting, and managing files, permissions, and process monitoring.
  • Investigate production issues, carry out root-cause analysis, and implement fixes with a focus on stability, resilience, and repeatable operations.
  • Collaborate with upstream and downstream colleagues (for example, data producers, data consumers, quality assurance, platform, and operations) to deliver reliable data products.
  • Ensure solutions meet financial services expectations for data quality, auditability, data lineage, and operational controls.
  • Produce clear technical documentation such as data mappings, job designs, runbooks, and operational procedures.

To be successful in this role, you should meet the following requirements:

  • Demonstrable experience delivering data engineering and/or data integration solutions in a production environment.
  • Strong hands-on capability with IBM DataStage (job design, parallelism, performance tuning, and error handling).
  • Strong hands-on capability with PySpark (DataFrames, transformations and actions, and optimisation techniques).
  • Strong hands-on capability with ControlM (scheduling, monitoring, incident handling, and job orchestration).
  • Working knowledge of Linux/Unix, including shell scripting and environment troubleshooting.
  • Experience in a banking or financial services context (for example, risk, finance reporting, payments, antimoney laundering (AML), regulatory reporting, treasury, or customer data).
  • Experience supporting live services, including on-call and incident processes, and working to service level agreements (SLAs).
  • Strong analytical and problem-solving skills, with the ability to communicate clearly with both technical and non-technical stakeholders.

Youll achieve more when you join HSBC.

www.hsbc.com/careers

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by HSBC Software Development India