Posted 14 days ago
No clicks
**Role: Specialist Software Engineer - Spark/Scala, Java full stack** **Summary:** *Design, develop and maintain scalable data processing applications using Spark, Scala, and Java. Collaborate across phases of the SDLC, following Agile methodologies. Bring expertise in data engineering, backend development, and production support.* **Key Responsibilities:** * Design, develop, and maintain scalable data processing applications * Build and optimize data pipelines, ETL processes, and data integration solutions * Contribute across all SDLC phases following Agile and engineering best practices * Develop reusable, reliable, and high-quality solutions with a focus on performance, reliability, and operational excellence * Collaborate with cross-functional teams to define and implement APIs, data access standards, and integration solutions * Monitor, troubleshoot, and resolve production issues, providing Level 2 and Level 3 support * Automate operational and production support activities to increase efficiency * Mentor team members and contribute to establishing engineering guidelines and best practices **Required Skills:** * Apache Spark (5+ years) * Scala (5+ years) * Data Engineering: data pipelines, ETL processes, distributed computing, data processing, performance optimization * Backend Development: microservices, Java 17+, Spring Boot, RESTful APIs, API design, service-oriented architecture * Software Engineering: Agile methodologies, SDLC processes, code reviews, unit testing, software craftsmanship practices * Strong problem-solving and debugging skills * Experience with Kafka, Hive, HDFS, Airflow/Oozie, and Hadoop Ecosystem tools **Primary Skills Listed:** * Spark, Scala, Python, Kafka, Hive, HDFS, Air
- Compensation
- Not specified
- City
- Not specified
- Country
- India
Currency: Not specified
Full Job Description
Specialist Software Engineer - SPARK/SCALA, Java full stack
Responsibilities
We are seeking a highly skilled Specialist Software Engineer with 5+ years of experience in Spark and Scala to join our Big Data Engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data processing applications that analyze and process large datasets across distributed platforms. This role requires strong expertise in data engineering, backend development, and production support, along with a passion for delivering high-quality, reusable, and reliable solutions.
Primary Skills: Spark, Scala, Python, Kafka, Hive, HDFS, Airflow/Oozie, Java 17, Spring Boot, REST APIs, Microservices.
ig Data & Data Engineering
- 5+ years of hands-on experience with Apache Spark and Scala.
- Strong experience in building and maintaining large-scale data pipelines and ETL processes.
- Experience with:
- Python
- Hadoop Ecosystem (HDFS)
- Hive
- Kafka
- Scheduling/Workflow tools such as Oozie or Airflow
- Strong understanding of distributed computing, data processing, and performance optimization techniques.
- Experience designing, developing, and deploying microservices using:
- Java 17+
- Spring Boot
- Strong expertise in building and maintaining RESTful APIs.
- Understanding of API design, integration patterns, and service-oriented architecture.
- Strong knowledge of Agile methodologies and SDLC processes.
- Experience with code reviews, unit testing, and software craftsmanship practices.
- Ability to write clean, maintainable, and reusable code.
- Excellent analytical, problem-solving, and debugging skills.
Profile required
- Design, develop, test, and maintain Spark-based applications for large-scale data processing and analytics.
- Build and optimize data ingestion, transformation, and integration pipelines across multiple data platforms.
- Independently design software components and deliver high-quality code that meets functional and non-functional requirements.
- Contribute across all phases of the Software Development Lifecycle (SDLC) following Agile and engineering best practices.
- Develop scalable, maintainable, and reusable solutions with a focus on performance, reliability, and operational excellence.
- Collaborate with cross-functional teams to define and implement APIs, data access standards, and integration solutions.
- Participate actively in Agile ceremonies, chapter meetings, design discussions, and technical reviews.
- Monitor, troubleshoot, and resolve production issues, providing Level 2 and Level 3 support when required.
- Identify recurring production issues and recommend improvements to enhance system stability and performance.
- Automate repetitive operational and production support activities to increase efficiency.
- Perform release validations and generate metrics, test reports, and defect reports.
- Ensure comprehensive documentation, including data models, metadata, data dictionaries, and data pipeline standards.
- Mentor team members and contribute to establishing engineering guidelines and best practices.
Why join us
We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.
Business insight
At Socit Gnrale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether youre joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!
Still hesitating?
You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.
We are committed to support accelerating our Groups ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.
Diversity and Inclusion
Titre Similar jobs
Specialist Software Engineer - SPARK/SCALA, Java full stack
Lead Software Engineer - DevOps
Titre Jobs & contracts
UX/UI Designer
Read moreAgile/Scrum master
Read moreCybersecurity Expert
Read more- Home
- Job offers
- Specialist Software Engineer - SPARK/SCALA, Java full stack
SIMILAR OPPORTUNITIES
Specialist Software Engineer - Java
Societe Generale
Added 14 days ago

Lead Software Engineer (Big Data; SPARK)
Wells Fargo Corporate & Investment Banking
Added 8 days ago

Principal Software Engineer (Java/Scala/.Net)
Morgan Stanley
Added 13 days ago

Senior Lead Software Engineer - Java & Databricks
J.P. Morgan
Added 11 days ago

Java Spark Developer
Citi
Added 5 days ago
