LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
Forgot password?
Don't have an account?
or
Join Canary Wharfian
By signing up, you agree to our Terms & Conditions and Privacy Policy.
or

Lead Software Engineer - Big Data(Data Engineer), Python, and AWS

ExperiencedNo visa sponsorship
J.P. Morgan logo

at J.P. Morgan

Bulge Bracket Investment Banks

Posted 13 days ago

No clicks

**Lead Software Engineer - Big Data & AWS** - Architect, build, and maintain critical data pipelines and platforms across diverse business units at JPMorganChase. - Drive data collection, storage, and analytics solutions using enterprise AI and Python. - 5+ years of data engineering experience, proficient in Big Data techs (Spark), AWS services (S3, Glue, Lambda), and Databricks. - Troubleshoot issues, automate remediation, and improve operational stability. CI/CD, security, and resiliency focus. - Collaborate in agile environments, align with business objectives, and manage complex enterprise data ecosystems.

Compensation
Not specified

Currency: Not specified

City
Not specified
Country
United States

Full Job Description

Location: Plano, TX, United States

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.  

As a Lead Software Engineer at JPMorganChase within the CIB, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology data products in a secure, stable, and scalable way. As a core technical contributor,  you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firms business objectives.  
 
Job responsibilities
  • Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or breakdown technical problems
  • Delivers data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way
  • Uses enterprise-authorized AI capabilities within the work environment to accelerate data products and model design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements.
  • Evaluates and reports on access control processes to determine effectiveness of data asset security with minimal supervision
  • Applies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations.
  • Develops secure and high-quality production code, and reviews and debugs code written by others
  • Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems

Required qualifications, capabilities, and skills
  • Formal training or certification on data engineering concepts and 5+ years applied experience 
  • Proficient at processing and analyzing large datasets using Big Data technologies, including Apache Spark, across data platforms comprising of Redshift, SQL DB, RDS and Databricks.
  • Design, development, and implementation of scalable data pipelines and data matching solutions on AWS, utilizing Python for data engineering tasks.
  • Strong experience in setup and configuration of services such as S3,  Step Functions, EMR, Glue, Lambda, RDS, EventBridge, Step-Functions and API Gateway for scripting, automation, and orchestration of data workflows.
  • Strong hands-on experience with Databricks and distributed data processing technologies.
  • Understanding of data architecture, data modeling, data integration, and data product principles.
  • Experience designing and operating large-scale data platforms and data products in complex enterprise environments.
  • Development of semantic layer for data consumption using Iceberg tables and APIs. 
  • Implementation of continuous deployment and integration processes using Infrastructure as Code tools, including Terraform.
  • Troubleshoot and resolve issues related to application code and data workflows.
  • Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
  • Working experience with both relational and NoSQL databases
  • Advanced in one or more programming language(s)
  • Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security

 

Preferred qualifications, capabilities, and skills

  • Experience working with modern enterprise data platforms and cloud-native data architectures.
  • Experience supporting real-time, analytical, or AI/ML-oriented data use cases.
  • Databricks, Snowflake, AWS cloud, or Data Engineering certifications
Carry out critical tech solutions across multiple technical areas as an integral part of an agile team

Lead Software Engineer - Big Data(Data Engineer), Python, and AWS

Compensation

Not specified

City: Not specified

Country: United States

J.P. Morgan logo
Bulge Bracket Investment Banks

13 days ago

No clicks

at J.P. Morgan

ExperiencedNo visa sponsorship

**Lead Software Engineer - Big Data & AWS** - Architect, build, and maintain critical data pipelines and platforms across diverse business units at JPMorganChase. - Drive data collection, storage, and analytics solutions using enterprise AI and Python. - 5+ years of data engineering experience, proficient in Big Data techs (Spark), AWS services (S3, Glue, Lambda), and Databricks. - Troubleshoot issues, automate remediation, and improve operational stability. CI/CD, security, and resiliency focus. - Collaborate in agile environments, align with business objectives, and manage complex enterprise data ecosystems.

Full Job Description

Location: Plano, TX, United States

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.  

As a Lead Software Engineer at JPMorganChase within the CIB, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology data products in a secure, stable, and scalable way. As a core technical contributor,  you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firms business objectives.  
 
Job responsibilities
  • Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or breakdown technical problems
  • Delivers data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way
  • Uses enterprise-authorized AI capabilities within the work environment to accelerate data products and model design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements.
  • Evaluates and reports on access control processes to determine effectiveness of data asset security with minimal supervision
  • Applies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations.
  • Develops secure and high-quality production code, and reviews and debugs code written by others
  • Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems

Required qualifications, capabilities, and skills
  • Formal training or certification on data engineering concepts and 5+ years applied experience 
  • Proficient at processing and analyzing large datasets using Big Data technologies, including Apache Spark, across data platforms comprising of Redshift, SQL DB, RDS and Databricks.
  • Design, development, and implementation of scalable data pipelines and data matching solutions on AWS, utilizing Python for data engineering tasks.
  • Strong experience in setup and configuration of services such as S3,  Step Functions, EMR, Glue, Lambda, RDS, EventBridge, Step-Functions and API Gateway for scripting, automation, and orchestration of data workflows.
  • Strong hands-on experience with Databricks and distributed data processing technologies.
  • Understanding of data architecture, data modeling, data integration, and data product principles.
  • Experience designing and operating large-scale data platforms and data products in complex enterprise environments.
  • Development of semantic layer for data consumption using Iceberg tables and APIs. 
  • Implementation of continuous deployment and integration processes using Infrastructure as Code tools, including Terraform.
  • Troubleshoot and resolve issues related to application code and data workflows.
  • Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
  • Working experience with both relational and NoSQL databases
  • Advanced in one or more programming language(s)
  • Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security

 

Preferred qualifications, capabilities, and skills

  • Experience working with modern enterprise data platforms and cloud-native data architectures.
  • Experience supporting real-time, analytical, or AI/ML-oriented data use cases.
  • Databricks, Snowflake, AWS cloud, or Data Engineering certifications
Carry out critical tech solutions across multiple technical areas as an integral part of an agile team