Software Engineer III - Data Engineer, Spark, Databricks, SQL
at J.P. Morgan
Posted 17 days ago
No clicks
Senior data engineer role responsible for designing, developing, and troubleshooting cloud data platform solutions using Spark, Databricks, and SQL. The position involves hands-on Python or Java development, building secure production code, automating remediation, and deriving insights from large datasets to improve systems. You will work with cloud technologies such as AWS S3, Snowflake, and Databricks, and participate in code reviews, data modeling, and operational stability efforts. The role also includes leading engineering communities of practice and contributing to a diverse and inclusive team culture.
- Compensation
- Not specified
- City
- Plano
- Country
- United States
Currency: Not specified
Full Job Description
Location: Plano, TX, United States
Job responsibilities
- Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Develops secure high-quality production code, and reviews and debugs code written by others
- Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
- Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
- Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
- Leads communities of practice across Software Engineering to drive awareness and use of new and leading-edge technologies
- Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
- Formal training or certification on Software Engineering concepts and 3+ years applied experience.
- Proven hands-on experience in Python or Java development on data platforms, including practical expertise with Apache Spark for large-scale data processing.
- Strong proficiency in SQL for data querying, transformation, and analysis.
- Experience with cloud data platform technology stacks such as AWS S3, Snowflake, and Databricks, with hands-on expertise in Spark, SQL, Unix, AWS, and data modeling.
- Knowledge of application, data, and infrastructure architecture disciplines.
- Knowledge of GIT, bitbucket, Maven, Jenkins, JIRA, Control-M or equivalent tools.
Demonstrated knowledge of software applications and technical processes within a technical discipline. (e.g. cloud, artificial intelligence, machine learning, etc.)
Preferred qualifications, capabilities, and skills
- Working experience on Kafka is a nice to have skill.
- Experience in Java 8/11/17, Object-Oriented design & analysis is a plus.
- Experience with Unix, shell scripts, is a plus.
