Senior Software Engineer - AI Platform

The AI Platform owns Datadog’s entire AI stack—everything from distributed training infrastructure (for our SOTA models) to the frameworks that power Bits AI, LLMObs, and the next wave of generative‑AI experiences. We’re expanding beyond model creation to the tooling that lets engineers ship production‑grade GenAI systems: retrieval‑augmented pipelines, autonomous agents, and evaluation harnesses.

We’re looking for a Senior Engineer to design and build this next‑gen platform, partner with Applied AI, product, and core‑infra teams to deliver:

Large‑scale experimentation, training, deployment, and monitoring

Developer toolchains for agents and other GenAI applications

Low‑latency serving infrastructure that plugs AI features into any Datadog product

At Datadog, we place value in our office culture - the relationships that it builds, the creativity it brings to the table, and the collaboration of being together. We operate as a hybrid workplace to ensure our employees can create a work-life harmony that best fits them.

What You’ll Do

Lead the design, development, and deployment of scalable tools and infrastructure to support the efforts of our data scientists (model training & serving infra, CI/CD, orchestration, deployment,...)

Create a development ecosystem that enables rapid experimentation and deployment of algorithms

Stay on the cutting edge of development in the MLOps domain and document best practices to share across teams

Drive the technical growth of Machine Learning as a distributed capability at Datadog, spanning all product areas, as well as leverage DD’s knowledge in observability to contribute back to the MLOps community

Who You Are

You have a BS/MS/PhD in a Computer Science, Engineering, Machine Learning or a related scientific field or equivalent experience

You are a software engineer at heart with 5+ years of professional experience in building distributed systems, data science applications, and/or machine learning engineering

You hav