Data Platform Engineer

This is Adyen

Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition.

For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster.

Sitting at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, Data Platform Engineers at Adyen build the foundational layer of tooling and processes for our on-premise Big Data Platforms. These tools support 10s of products, 100s of developers, and 1000s of daily jobs that add to Adyen’s strong portfolio of capabilities.

You’ll collaborate with data engineers and ML scientists and engineers to build and roll-out these tools. Along with DataOps Engineers, you’ll develop and operate multiple big data platforms, of which the biggest is 500+ nodes, with 25k+ CPU cores, 240+ TBs of RAM, and 23+ PBs of storage capacity, running tens of thousands of spark jobs a day.

What you’ll do

You’ll be asked to both build new tools and improve the existing tooling. This role is perfect for you if you're passionate about few of the following:

Develop and maintain scalable and high performance big data platforms.

Work with distributed systems in all shapes and flavors (databases, filesystems, compute, etc.)

Identify opportunities to improve continuous release and deployment environments

Build or deploy tools to enhance data discoverability through the collection and presentation of metadata

Introduce and extend tools to enhance the quality of our data, platform-wide

Explore and introduce technologies and practices to