Senior/Staff Machine Learning Engineer - Health Evaluation - AI Teams (x/f/m)

What you’ll do

At Doctolib, we're on a mission to transform how healthcare is delivered by harnessing the power of AI.

As a Senior/Staff Machine Learning Engineer, you’ll play a key role in designing, implementing, and scaling the evaluation framework that ensures our AI Health Companion behaves safely, reliably, and helpfully for millions of patients and practitioners.

You’ll join a cross-functional team of Machine Learning Engineers, Product Engineers, and Medical Experts to build robust evaluation pipelines for agentic AI systems — models capable of reasoning, planning, and interacting with complex healthcare data.

Your responsibilities include, but are not limited to

Define and own the evaluation strategy for our AI agentic system - metrics, protocols, datasets, and tooling

Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations

Run systematic experiments to assess reasoning, factuality, robustness, and user experience

Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement

Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices

About our tech environment

Our solutions are built on a single fully cloud-native platform that supports web and mobile app interfaces, multiple languages, and is adapted to the country and healthcare specialty requirements. To address these challenges, we are modularizing our platform run in a distributed architecture through reusable components

Our stack is composed of Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native

We leverage AI ethically across our products to empower patients and health professionals. Discover our AI vision here!

Who you are

Before you read on — if you don't have the exact profile described below, but you feel this job description matches your skill set, we still encourage you to apply.

MSc or PhD in Comput