LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
or continue with e-mail and password
Forgot password?
Don't have an account?
Create an account
or continue with e-mail and password
By signing up, you agree to our Terms & Conditions and Privacy Policy.

Senior Data Engineer

ExperiencedNo visa sponsorship

Posted 8 days ago

No clicks

**Senior GCP Data Engineer | Lead End-to-End Data Migrations** The role of Senior Data Engineer involves driving GCP cloud migrations, transforming systems from on-premises to BigQuery, Bigtable, and other GCP storage solutions. This position requires a seasoned migration expert, skilled in Python, SQL, Spark (Dataproc), and GCP tools like Cloud Composer, Kafka, and Pub/Sub. Experience in schema mapping, data transformation, and large-volume data transfers is essential. Collaborate cross-functionally for seamless migrations, optimize workloads, and govern metadata using Dataplex and Data Catalog. Deep understanding of databases (MySQL, Hive, MongoDB) and APIs (Apigee) is a plus.

Compensation
Not specified

Currency: Not specified

City
Not specified
Country
United States, Canada

Full Job Description

We are seeking an experienced GCP Data Engineer to lead and deliver endtoend data migration initiatives from onpremises or legacy systems to Google Cloud Platform (GCP). The ideal candidate will bring deep expertise in data migration strategy, cloudnative data services, and largescale data transformation and validation, ensuring high data integrity and minimal downtime during migrations.

Key Responsibilities

  • Design and execute comprehensive data migration strategies from onpremises, legacy platforms, or other cloud environments to GCP.
  • Migrate structured and semistructured data to BigQuery, Bigtable, and other GCP storage solutions.
  • Build, optimize, and maintain scalable migration pipelines using Python, SQL, and distributed processing frameworks on Dataproc (Apache Spark).
  • Implement batch and streaming migration patterns using Cloud Composer (Apache Airflow), Kafka, and Google Pub/Sub.
  • Perform schema mapping, data transformation, reconciliation, and validation to ensure accuracy, consistency, and completeness of migrated datasets.
  • Enable metadata management, lineage, and governance using Dataplex and Data Catalog.
  • Handle largevolume data transfers using industry best practices such as parallel loading, incremental loads, and CDC where applicable.
  • Lead migrations from onpremise RDBMS, enterprise data warehouses, or Hadoop ecosystems.
  • Collaborate closely with application, data, infrastructure, and security teams to ensure seamless migrations with minimal business disruption.
  • Optimize migrated workloads for performance, scalability, and cost efficiency on GCP.
  • Troubleshoot migration issues and support postmigration stabilization and continuous optimization.
  • Document migration architectures, processes, and operational runbooks.

Required Technical Skills

  • Google Cloud Platform (GCP)
  • BigQuery
  • Dataproc / Apache Spark
  • Python (ETL/ELT pipelines and automation)
  • SQL (data transformation, validation, and reconciliation)
  • Databases: MySQL, Hive, MongoDB
  • Cloud Composer / Apache Airflow
  • Kafka and Google Pub/Sub
  • Bigtable
  • Apigee / REST APIs (data extraction and integration)
  • Dataplex / Data Catalog (metadata management and governance)

Good to Have

  • Experience with Change Data Capture (CDC) patterns
  • Data quality, audit, and reconciliation frameworks
  • CI/CD implementation for data pipelines

Posting End Date: 

29 May 2026

*Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business units risk appetite and all risk and compliance program requirements.

Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.

Applicants with Disabilities

To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo.

Drug and Alcohol Policy

 

Wells Fargo maintains a drug free workplace.  Please see our Drug and Alcohol Policy to learn more.

Wells Fargo Recruitment and Hiring Requirements:

a. Third-Party recordings are prohibited unless authorized by Wells Fargo.

b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.


Senior Data Engineer

Compensation

Not specified

City: Not specified

Country: United States, Canada

Wells Fargo Corporate & Investment Banking  logo
Investment Banking

8 days ago

No clicks

at Wells Fargo Corporate & Investment Banking

ExperiencedNo visa sponsorship

**Senior GCP Data Engineer | Lead End-to-End Data Migrations** The role of Senior Data Engineer involves driving GCP cloud migrations, transforming systems from on-premises to BigQuery, Bigtable, and other GCP storage solutions. This position requires a seasoned migration expert, skilled in Python, SQL, Spark (Dataproc), and GCP tools like Cloud Composer, Kafka, and Pub/Sub. Experience in schema mapping, data transformation, and large-volume data transfers is essential. Collaborate cross-functionally for seamless migrations, optimize workloads, and govern metadata using Dataplex and Data Catalog. Deep understanding of databases (MySQL, Hive, MongoDB) and APIs (Apigee) is a plus.

Full Job Description

We are seeking an experienced GCP Data Engineer to lead and deliver endtoend data migration initiatives from onpremises or legacy systems to Google Cloud Platform (GCP). The ideal candidate will bring deep expertise in data migration strategy, cloudnative data services, and largescale data transformation and validation, ensuring high data integrity and minimal downtime during migrations.

Key Responsibilities

  • Design and execute comprehensive data migration strategies from onpremises, legacy platforms, or other cloud environments to GCP.
  • Migrate structured and semistructured data to BigQuery, Bigtable, and other GCP storage solutions.
  • Build, optimize, and maintain scalable migration pipelines using Python, SQL, and distributed processing frameworks on Dataproc (Apache Spark).
  • Implement batch and streaming migration patterns using Cloud Composer (Apache Airflow), Kafka, and Google Pub/Sub.
  • Perform schema mapping, data transformation, reconciliation, and validation to ensure accuracy, consistency, and completeness of migrated datasets.
  • Enable metadata management, lineage, and governance using Dataplex and Data Catalog.
  • Handle largevolume data transfers using industry best practices such as parallel loading, incremental loads, and CDC where applicable.
  • Lead migrations from onpremise RDBMS, enterprise data warehouses, or Hadoop ecosystems.
  • Collaborate closely with application, data, infrastructure, and security teams to ensure seamless migrations with minimal business disruption.
  • Optimize migrated workloads for performance, scalability, and cost efficiency on GCP.
  • Troubleshoot migration issues and support postmigration stabilization and continuous optimization.
  • Document migration architectures, processes, and operational runbooks.

Required Technical Skills

  • Google Cloud Platform (GCP)
  • BigQuery
  • Dataproc / Apache Spark
  • Python (ETL/ELT pipelines and automation)
  • SQL (data transformation, validation, and reconciliation)
  • Databases: MySQL, Hive, MongoDB
  • Cloud Composer / Apache Airflow
  • Kafka and Google Pub/Sub
  • Bigtable
  • Apigee / REST APIs (data extraction and integration)
  • Dataplex / Data Catalog (metadata management and governance)

Good to Have

  • Experience with Change Data Capture (CDC) patterns
  • Data quality, audit, and reconciliation frameworks
  • CI/CD implementation for data pipelines

Posting End Date: 

29 May 2026

*Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business units risk appetite and all risk and compliance program requirements.

Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.

Applicants with Disabilities

To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo.

Drug and Alcohol Policy

 

Wells Fargo maintains a drug free workplace.  Please see our Drug and Alcohol Policy to learn more.

Wells Fargo Recruitment and Hiring Requirements:

a. Third-Party recordings are prohibited unless authorized by Wells Fargo.

b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.