LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
or continue with e-mail and password
Forgot password?
Don't have an account?
Join Canary Wharfian
or continue with e-mail and password
By signing up, you agree to our Terms & Conditions and Privacy Policy.

Senior software engineer - Data Platform Engineer (OLAP)

ExperiencedNo visa sponsorship
Adyen logo

at Adyen

FinTech

Posted 5 days ago

No clicks

**Senior Software Engineer - Data Platform Engineer (OLAP)** Drive Adyen's expansive data platform, balancing innovative tool building with infrastructure improvement. Collaborate with data engineers and ML scientists, optimizing extensive on-premise Big Data Platforms (500+ nodes, 23PB storage). Key responsibilities include: - Scaling and optimizing real-time analytics using Druid, FastAPI, Java, Kafka in the OLAP ecosystem. - Designing data contracts, validation frameworks, and robust Kafka ingestion pipelines for data engineering. - Maintaining distributed systems, enhancing metadata collection, data lineage, and platform-wide data quality. - Streamlining CI/CD and optimizing continuous release/deployment environments in a large-scale private cloud. - Developing stream processing applications and frameworks for reduced time-to-insight. demostrar Python or Java skills with 6+ years of experience. Proven expertise in distributed system architecture and strong communication skills to bridge teams. At Adyen, your unique perspectives matter, fostering an inclusive environment where you can truly own your career. Apply now!

Compensation
Not specified EUR

Currency: € (EUR)

City
Amsterdam
Country
Netherlands

Full Job Description

This is Adyen

Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition.

For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster.

Sitting at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, Data Platform Engineers at Adyen build the foundational layer of tooling and processes for our on-premise Big Data Platforms. These tools support 10s of products, 100s of developers, and 1000s of daily jobs that add to Adyens strong portfolio of capabilities.

Youll collaborate with data engineers and ML scientists and engineers to build and roll-out these tools. Along with DataOps Engineers, youll develop and operate multiple big data platforms, of which the biggest is 500+ nodes, with 25k+ CPU cores, 240+ TBs of RAM, and 23+ PBs of storage capacity, running tens of thousands of spark jobs a day.

Your Focus Areas

We are currently expanding our platform capabilities. Depending on your expertise, your immediate focus will be driving one of these two key ecosystems:

  • The OLAP Ecosystem: Scaling and optimizing our real-time analytical powerhouses (Druid, FastAPI, Java, Kafka).

  • The Data Engineering Ecosystem: Designing and building data contracts, validation frameworks, optimization tooling, and robust Kafka ingestion pipelines.

What Youll Do

You will balance building innovative new tools from scratch with relentlessly improving our existing infrastructure. This role is a perfect fit if you are passionate about:

  • Scale: Developing and maintaining high-performance, distributed big data platforms.

  • Distributed Systems: Working deeply with various flavors of databases, filesystems, and compute engines.

  • Data Quality & Discoverability: Building tools that enhance metadata collection, data lineage, and platform-wide data quality.

  • CI/CD & Infrastructure: Optimizing continuous release/deployment environments within a large-scale private cloud system.

  • Streaming: Developing stream processing applications and frameworks to reduce time-to-insight for analysts and data scientists.

Who You Are

  • Python or Java Expert: 6+ years of experience with object-oriented programming.

  • Collaborative Enabler: A strong communicator who thrives on building bridges between the teams you enable (analysts, data scientists) and the teams you depend on (infrastructure, security).

  • Distributed Systems Architect: Proven experience developing and maintaining:

    • Distributed compute/data systems (e.g., Spark, Trino, Druid, ClickHouse).

    • Real-time and batch pipelines (Kafka, Spark Streaming) with a focus on user-friendliness and reliability.

Our Diversity, Equity and Inclusion commitments

Our unique approach is a product of our diverse perspectives. This diversity of backgrounds and cultures is essential in helping us maintain our momentum. Our business and technical challenges are unique, and we need as many different voices as possible to join us in solving them - voices like yours. No matter who you are or where youre from, we welcome you to be your true self at Adyen.

Studies show that women and members of underrepresented communities apply for jobs only if they meet 100% of the qualifications. Does this sound like you? If so, Adyen encourages you to reconsider and apply. We look forward to your application!

Whats next?

Ensuring a smooth and enjoyable candidate experience is critical for us. We aim to get back to you regarding your application within 5 business days. Our interview process tends to take about 4 weeks to complete, but may fluctuate depending on the role. Learn more about our hiring process here. Dont be afraid to let us know if you need more flexibility.

This role is based out of our Amsterdam office. We are an office-first company and value in-person collaboration; we do not offer remote-only roles.

Senior software engineer - Data Platform Engineer (OLAP)

Compensation

Not specified EUR

City: Amsterdam

Country: Netherlands

Adyen logo
FinTech

5 days ago

No clicks

at Adyen

ExperiencedNo visa sponsorship

**Senior Software Engineer - Data Platform Engineer (OLAP)** Drive Adyen's expansive data platform, balancing innovative tool building with infrastructure improvement. Collaborate with data engineers and ML scientists, optimizing extensive on-premise Big Data Platforms (500+ nodes, 23PB storage). Key responsibilities include: - Scaling and optimizing real-time analytics using Druid, FastAPI, Java, Kafka in the OLAP ecosystem. - Designing data contracts, validation frameworks, and robust Kafka ingestion pipelines for data engineering. - Maintaining distributed systems, enhancing metadata collection, data lineage, and platform-wide data quality. - Streamlining CI/CD and optimizing continuous release/deployment environments in a large-scale private cloud. - Developing stream processing applications and frameworks for reduced time-to-insight. demostrar Python or Java skills with 6+ years of experience. Proven expertise in distributed system architecture and strong communication skills to bridge teams. At Adyen, your unique perspectives matter, fostering an inclusive environment where you can truly own your career. Apply now!

Full Job Description

This is Adyen

Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition.

For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster.

Sitting at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, Data Platform Engineers at Adyen build the foundational layer of tooling and processes for our on-premise Big Data Platforms. These tools support 10s of products, 100s of developers, and 1000s of daily jobs that add to Adyens strong portfolio of capabilities.

Youll collaborate with data engineers and ML scientists and engineers to build and roll-out these tools. Along with DataOps Engineers, youll develop and operate multiple big data platforms, of which the biggest is 500+ nodes, with 25k+ CPU cores, 240+ TBs of RAM, and 23+ PBs of storage capacity, running tens of thousands of spark jobs a day.

Your Focus Areas

We are currently expanding our platform capabilities. Depending on your expertise, your immediate focus will be driving one of these two key ecosystems:

  • The OLAP Ecosystem: Scaling and optimizing our real-time analytical powerhouses (Druid, FastAPI, Java, Kafka).

  • The Data Engineering Ecosystem: Designing and building data contracts, validation frameworks, optimization tooling, and robust Kafka ingestion pipelines.

What Youll Do

You will balance building innovative new tools from scratch with relentlessly improving our existing infrastructure. This role is a perfect fit if you are passionate about:

  • Scale: Developing and maintaining high-performance, distributed big data platforms.

  • Distributed Systems: Working deeply with various flavors of databases, filesystems, and compute engines.

  • Data Quality & Discoverability: Building tools that enhance metadata collection, data lineage, and platform-wide data quality.

  • CI/CD & Infrastructure: Optimizing continuous release/deployment environments within a large-scale private cloud system.

  • Streaming: Developing stream processing applications and frameworks to reduce time-to-insight for analysts and data scientists.

Who You Are

  • Python or Java Expert: 6+ years of experience with object-oriented programming.

  • Collaborative Enabler: A strong communicator who thrives on building bridges between the teams you enable (analysts, data scientists) and the teams you depend on (infrastructure, security).

  • Distributed Systems Architect: Proven experience developing and maintaining:

    • Distributed compute/data systems (e.g., Spark, Trino, Druid, ClickHouse).

    • Real-time and batch pipelines (Kafka, Spark Streaming) with a focus on user-friendliness and reliability.

Our Diversity, Equity and Inclusion commitments

Our unique approach is a product of our diverse perspectives. This diversity of backgrounds and cultures is essential in helping us maintain our momentum. Our business and technical challenges are unique, and we need as many different voices as possible to join us in solving them - voices like yours. No matter who you are or where youre from, we welcome you to be your true self at Adyen.

Studies show that women and members of underrepresented communities apply for jobs only if they meet 100% of the qualifications. Does this sound like you? If so, Adyen encourages you to reconsider and apply. We look forward to your application!

Whats next?

Ensuring a smooth and enjoyable candidate experience is critical for us. We aim to get back to you regarding your application within 5 business days. Our interview process tends to take about 4 weeks to complete, but may fluctuate depending on the role. Learn more about our hiring process here. Dont be afraid to let us know if you need more flexibility.

This role is based out of our Amsterdam office. We are an office-first company and value in-person collaboration; we do not offer remote-only roles.