LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
Forgot password?
Don't have an account?
or
Join Canary Wharfian
By signing up, you agree to our Terms & Conditions and Privacy Policy.
or

Data Engineer- BPL-CIO

ExperiencedNo visa sponsorship
Barclays logo

at Barclays

Bulge Bracket Investment Banks

Posted 6 days ago

No clicks

**Data Engineer - BPL-CIO | London-based, 3 office days per week** Shape and deliver a new payments data platform, working hands-on with Databricks and AWS. Key responsibilities include: - Designing and building production-grade Databricks platforms and reliable data pipelines using Python, PySpark, and SQL. - Collaborating with domain teams to build early data products and establish engineering standards. - Evolving the platform towards self-service capabilities and reusable tooling. Required skills and experience: - Proven production Databricks and data pipeline engineering experience. - Software engineering abilities, including automated testing and CI/CD deployment. - Secure and operable platform engineering skills, covering identity and access control, encryption, and incident response. Suitable candidates will display excellent risk management, change management, and business acumen, with the ability to advise key stakeholders. The role is based in London's 1 Churchill Place or 7 Westferry Circus offices, with a hybrid working pattern.

Compensation
Not specified

Currency: Not specified

City
London
Country
United Kingdom

Full Job Description

Join us as a Data Engineer and help build the data platform that will underpin a new standalone payments business.


As one of the first permanent engineers in the team, you will play a hands-on role in both shaping the platform and delivering the initial data products that run on it. Working with Databricks and AWS, you will design and build production-grade data pipelines, establish engineering standards and create the reusable patterns, automation and controls that will form the foundation of the platform.


This is not a role where platform engineering is separated from delivery. We believe the best platform capabilities emerge from solving real business problems. You will work closely with domain teams, building early data products, identifying common requirements and turning successful approaches into repeatable golden paths that make it easier for future teams to onboard and succeed.


As the platform evolves, your focus will increasingly shift from hands-on support towards self-service capabilities, reusable tooling and platform features that enable domain teams to build and operate trusted data products independently.


To be successful as a Data Engineer, you must have the following essential skills;


Production Databricks and data pipeline engineering

  • Hands-on experience building production-grade Databricks platforms and reliable batch and streaming pipelines using Python, PySpark and SQL.

Software engineering, testing and automated delivery

  • The ability to create modular, maintainable and reusable components, supported by automated pipeline testing, Git-based workflows and CI/CD deployment.

Secure and operable platform engineering

  • Experience engineering systems for sensitive or regulated data, including identity and access control, encryption, secrets management, least privilege, monitoring and production incident resolution.

Some other highly valued skills may include;

Advanced Unity Catalog expertise

  • Practical experience configuring lineage, permissions, metadata and governance through Unity Catalog.

Infrastructure-as-code and Databricks deployment automation

  • Experience with Terraform, Databricks Asset Bundles and GitHub Actions or equivalent policy-controlled delivery tooling.

Platform product and self-service engineering

  • Experience creating paved roads, golden paths, metadata-driven automation or internal developer platforms that enable domain teams to build compliant data products with less manual support.

You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills

The successful candidate will be based in London. Our offices are located at 1 Churchill Place and 7 Westferry Circus (new BPL office). We support a hybrid working pattern with 3 days per week office-based presence expected. 

Barclays payments acceptance business provides critical infrastructure to the UK economy, processing billions of pounds of payments annually for both small businesses and domestic and international corporate clients. 

In April 2025, we announced a long-term partnership with Brookfield Asset Management to grow and transform the payments acceptance business by broadening the range of services offered, enhancing the experience for both existing and prospective clients. Leveraging extensive client relationships and deep experience of UK payments, we will create an environment of continuous innovation - activated by Brookfields global private equity expertise in payments, technology, operational transformation and corporate carve-outs - to ensure the business is strategically positioned for long-term growth.

Barclays will invest approximately 400m in the new business, the majority of which will be incurred during the first three years. Performance-linked incentives will drive greater alignment between the partners, underpinning the long-term commitment to the transformation. Barclays and Brookfield will work to create a standalone entity over time, continuing to use the Barclaycard Payments (BPL) brand and acting as the sole payments acceptance services provider to Barclays clients for a minimum of ten years. 

For more information on our partnership with Brookfield, please visit Barclays.com (opens in new window).

Purpose of the role

To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. 

Accountabilities

  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes.
  • Collaboration with data scientist to build and deploy machine learning models.

Vice President Expectations

  • To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escalate breaches of policies/procedures..
  • If managing a team, they define jobs and responsibilities, planning for the departments future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements..
  • If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L Listen and be authentic, E Energise and inspire, A Align across the enterprise, D Develop others..
  • OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions..
  • Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
  • Manage and mitigate risks through assessment, in support of the control and governance agenda.
  • Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
  • Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
  • Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
  • Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
  • Adopt and include the outcomes of extensive research in problem solving processes.
  • Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset to Empower, Challenge and Drive the operating manual for how we behave.

Back to nav

Data Engineer- BPL-CIO

Compensation

Not specified

City: London

Country: United Kingdom

Barclays logo
Bulge Bracket Investment Banks

6 days ago

No clicks

at Barclays

ExperiencedNo visa sponsorship

**Data Engineer - BPL-CIO | London-based, 3 office days per week** Shape and deliver a new payments data platform, working hands-on with Databricks and AWS. Key responsibilities include: - Designing and building production-grade Databricks platforms and reliable data pipelines using Python, PySpark, and SQL. - Collaborating with domain teams to build early data products and establish engineering standards. - Evolving the platform towards self-service capabilities and reusable tooling. Required skills and experience: - Proven production Databricks and data pipeline engineering experience. - Software engineering abilities, including automated testing and CI/CD deployment. - Secure and operable platform engineering skills, covering identity and access control, encryption, and incident response. Suitable candidates will display excellent risk management, change management, and business acumen, with the ability to advise key stakeholders. The role is based in London's 1 Churchill Place or 7 Westferry Circus offices, with a hybrid working pattern.

Full Job Description

Join us as a Data Engineer and help build the data platform that will underpin a new standalone payments business.


As one of the first permanent engineers in the team, you will play a hands-on role in both shaping the platform and delivering the initial data products that run on it. Working with Databricks and AWS, you will design and build production-grade data pipelines, establish engineering standards and create the reusable patterns, automation and controls that will form the foundation of the platform.


This is not a role where platform engineering is separated from delivery. We believe the best platform capabilities emerge from solving real business problems. You will work closely with domain teams, building early data products, identifying common requirements and turning successful approaches into repeatable golden paths that make it easier for future teams to onboard and succeed.


As the platform evolves, your focus will increasingly shift from hands-on support towards self-service capabilities, reusable tooling and platform features that enable domain teams to build and operate trusted data products independently.


To be successful as a Data Engineer, you must have the following essential skills;


Production Databricks and data pipeline engineering

  • Hands-on experience building production-grade Databricks platforms and reliable batch and streaming pipelines using Python, PySpark and SQL.

Software engineering, testing and automated delivery

  • The ability to create modular, maintainable and reusable components, supported by automated pipeline testing, Git-based workflows and CI/CD deployment.

Secure and operable platform engineering

  • Experience engineering systems for sensitive or regulated data, including identity and access control, encryption, secrets management, least privilege, monitoring and production incident resolution.

Some other highly valued skills may include;

Advanced Unity Catalog expertise

  • Practical experience configuring lineage, permissions, metadata and governance through Unity Catalog.

Infrastructure-as-code and Databricks deployment automation

  • Experience with Terraform, Databricks Asset Bundles and GitHub Actions or equivalent policy-controlled delivery tooling.

Platform product and self-service engineering

  • Experience creating paved roads, golden paths, metadata-driven automation or internal developer platforms that enable domain teams to build compliant data products with less manual support.

You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills

The successful candidate will be based in London. Our offices are located at 1 Churchill Place and 7 Westferry Circus (new BPL office). We support a hybrid working pattern with 3 days per week office-based presence expected. 

Barclays payments acceptance business provides critical infrastructure to the UK economy, processing billions of pounds of payments annually for both small businesses and domestic and international corporate clients. 

In April 2025, we announced a long-term partnership with Brookfield Asset Management to grow and transform the payments acceptance business by broadening the range of services offered, enhancing the experience for both existing and prospective clients. Leveraging extensive client relationships and deep experience of UK payments, we will create an environment of continuous innovation - activated by Brookfields global private equity expertise in payments, technology, operational transformation and corporate carve-outs - to ensure the business is strategically positioned for long-term growth.

Barclays will invest approximately 400m in the new business, the majority of which will be incurred during the first three years. Performance-linked incentives will drive greater alignment between the partners, underpinning the long-term commitment to the transformation. Barclays and Brookfield will work to create a standalone entity over time, continuing to use the Barclaycard Payments (BPL) brand and acting as the sole payments acceptance services provider to Barclays clients for a minimum of ten years. 

For more information on our partnership with Brookfield, please visit Barclays.com (opens in new window).

Purpose of the role

To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. 

Accountabilities

  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes.
  • Collaboration with data scientist to build and deploy machine learning models.

Vice President Expectations

  • To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escalate breaches of policies/procedures..
  • If managing a team, they define jobs and responsibilities, planning for the departments future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements..
  • If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L Listen and be authentic, E Energise and inspire, A Align across the enterprise, D Develop others..
  • OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions..
  • Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
  • Manage and mitigate risks through assessment, in support of the control and governance agenda.
  • Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
  • Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
  • Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
  • Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
  • Adopt and include the outcomes of extensive research in problem solving processes.
  • Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset to Empower, Challenge and Drive the operating manual for how we behave.

Back to nav