LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
Forgot password?
Don't have an account?
or
Join Canary Wharfian
By signing up, you agree to our Terms & Conditions and Privacy Policy.
or

Data Engineering Technical Lead

ExperiencedVisa sponsorship available
Vanguard logo

at Vanguard

Asset Management

Posted a month ago

No clicks

**Data Engineering Technical Lead** Lead Vanguard Europe's data evolution, driving scalable AWS/Databricks platforms. Design, optimize, and manage data lakes, pipelines, and real-time processing. Ensure data quality, governance, and security using Unity Catalog. Collaborate cross-functionally and mentor data engineers, fostering best practices. Expertise in Databricks, PySpark, SQL, and cloud-based data platforms required.

Compensation
Not specified

Currency: Not specified

City
Manchester
Country
United Kingdom

Full Job Description

Job Title

Data Engineering Technical Lead

The Role

The Data Engineering Technical Lead will play a critical role in shaping and delivering Vanguard Europe's data and analytics capabilities. Working within the Chief Data & Analytics Office (CDAO), this role will lead the technical design, development, and evolution of data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions.


Lead the design, development, and optimization of scalable data platforms and data products on AWS tech stack and Databricks. Drive engineering best practices, mentor data engineers, and deliver high-quality data solutions that support analytics, reporting, and AI initiatives.

In this role you will

Design and build scalable data pipelines using Databricks, PySpark, SQL, AWS Glue and Lambda.

Develop and manage Data Lake solutions using Bronze, Silver, and Gold data architectures.

Implement batch and real-time data processing using Spark Structured Streaming and Auto Loader.

Optimize Databricks workloads for performance, scalability, reliability, and cost efficiency.

Establish data quality, governance, and security controls using Unity Catalog and enterprise best practices.

Lead technical delivery, code reviews, and engineering standards across the data engineering team.

Collaborate with Product Managers, Architects, Analysts, and business stakeholders to deliver data products.

Implement CI/CD and Infrastructure as Code using Terraform and modern DevOps practices.

Mentor engineers and promote best practices in Databricks and data engineering.

What it takes


Must-Have Skills & Experience

Expert-level experience with Databricks, PySpark, SQL, and Apache Spark

Strong experience designing and delivering cloud-based data platforms and lakehouse architectures

Hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and performance tuning

Experience building batch and streaming data pipelines

Strong knowledge of data modelling and data product design

Experience with Terraform, Git, CI/CD, and automated testing

Proven leadership and stakeholder management skills

.

Nice-to-Have Skills & Experience

AWS data platform experience

Experience with Delta Live Tables (DLT) and MLflow

Knowledge of AI/ML, MLOps, and Generative AI solutions on Databricks

Financial Services industry experience

Special Factors

Vanguard is not offering visa sponsorship for this position

This is a hybrid position and would require you to work in the office 3 days per week (Tuesday, Wednesday & Thursday)

Please note that we review applications on a rolling basis and may close this role early if there is a high level of interest. To avoid missing out, we recommend applying as soon as possible

Why Vanguard?

Vanguard is a different kind of investment company. It was founded in the United States in 1975 on a simple but revolutionary idea: that an investment company should manage its funds solely in the interests of its clients.

This is a philosophy that has helped millions of people around the world to achieve their goals with low-cost, uncomplicated investments.

It's what we stand for: value to investors.

Inclusion Statement

Vanguards continued commitment to diversity and inclusion is firmly rooted in our culture. Every decision we make to best serve our clients, crew (internally employees are referred to as crew), and communities is guided by one simple statement: Do the right thing.

We believe that a critical aspect of doing the right thing requires building diverse, inclusive, and highly effective teams of individuals who are as unique as the clients they serve. We empower our crew to contribute their distinct strengths to achieving Vanguards core purpose through our values.

When all crew members feel valued and included, our ability to collaborate and innovate is amplified, and we are united in delivering on Vanguard's core purpose: to take a stand for all investors, to treat them fairly, and to give them the best chance for investment success.

How We Work

Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.

Data Engineering Technical Lead

Compensation

Not specified

City: Manchester

Country: United Kingdom

Vanguard logo
Asset Management

a month ago

No clicks

at Vanguard

ExperiencedVisa sponsorship available

**Data Engineering Technical Lead** Lead Vanguard Europe's data evolution, driving scalable AWS/Databricks platforms. Design, optimize, and manage data lakes, pipelines, and real-time processing. Ensure data quality, governance, and security using Unity Catalog. Collaborate cross-functionally and mentor data engineers, fostering best practices. Expertise in Databricks, PySpark, SQL, and cloud-based data platforms required.

Full Job Description

Job Title

Data Engineering Technical Lead

The Role

The Data Engineering Technical Lead will play a critical role in shaping and delivering Vanguard Europe's data and analytics capabilities. Working within the Chief Data & Analytics Office (CDAO), this role will lead the technical design, development, and evolution of data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions.


Lead the design, development, and optimization of scalable data platforms and data products on AWS tech stack and Databricks. Drive engineering best practices, mentor data engineers, and deliver high-quality data solutions that support analytics, reporting, and AI initiatives.

In this role you will

Design and build scalable data pipelines using Databricks, PySpark, SQL, AWS Glue and Lambda.

Develop and manage Data Lake solutions using Bronze, Silver, and Gold data architectures.

Implement batch and real-time data processing using Spark Structured Streaming and Auto Loader.

Optimize Databricks workloads for performance, scalability, reliability, and cost efficiency.

Establish data quality, governance, and security controls using Unity Catalog and enterprise best practices.

Lead technical delivery, code reviews, and engineering standards across the data engineering team.

Collaborate with Product Managers, Architects, Analysts, and business stakeholders to deliver data products.

Implement CI/CD and Infrastructure as Code using Terraform and modern DevOps practices.

Mentor engineers and promote best practices in Databricks and data engineering.

What it takes


Must-Have Skills & Experience

Expert-level experience with Databricks, PySpark, SQL, and Apache Spark

Strong experience designing and delivering cloud-based data platforms and lakehouse architectures

Hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and performance tuning

Experience building batch and streaming data pipelines

Strong knowledge of data modelling and data product design

Experience with Terraform, Git, CI/CD, and automated testing

Proven leadership and stakeholder management skills

.

Nice-to-Have Skills & Experience

AWS data platform experience

Experience with Delta Live Tables (DLT) and MLflow

Knowledge of AI/ML, MLOps, and Generative AI solutions on Databricks

Financial Services industry experience

Special Factors

Vanguard is not offering visa sponsorship for this position

This is a hybrid position and would require you to work in the office 3 days per week (Tuesday, Wednesday & Thursday)

Please note that we review applications on a rolling basis and may close this role early if there is a high level of interest. To avoid missing out, we recommend applying as soon as possible

Why Vanguard?

Vanguard is a different kind of investment company. It was founded in the United States in 1975 on a simple but revolutionary idea: that an investment company should manage its funds solely in the interests of its clients.

This is a philosophy that has helped millions of people around the world to achieve their goals with low-cost, uncomplicated investments.

It's what we stand for: value to investors.

Inclusion Statement

Vanguards continued commitment to diversity and inclusion is firmly rooted in our culture. Every decision we make to best serve our clients, crew (internally employees are referred to as crew), and communities is guided by one simple statement: Do the right thing.

We believe that a critical aspect of doing the right thing requires building diverse, inclusive, and highly effective teams of individuals who are as unique as the clients they serve. We empower our crew to contribute their distinct strengths to achieving Vanguards core purpose through our values.

When all crew members feel valued and included, our ability to collaborate and innovate is amplified, and we are united in delivering on Vanguard's core purpose: to take a stand for all investors, to treat them fairly, and to give them the best chance for investment success.

How We Work

Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.