KeyStep

Data Scientist

SumUp
Berlin, Germany
6 days ago
full-time

Skills & Technologies

FinTechQAMachine LearningLLMForecastingCustomer ExperienceCustomer SupportDeploymentAIAutomationBenchmarking

Job Description

About the team

Within Global Operations, our mission is to deliver the best customer experience in the fintech industry by providing an effortless, high-quality experience for every merchant. We are looking for a skilled and passionate Data Scientist to join our AI Team, contributing to the development of customer-facing models and the evaluation of our AI products. Your work will help elevate our customer support by improving quality, identifying gaps, and tailoring the experience to merchants’ needs.

As a Data Scientist at SumUp, you will design, test, and implement both traditional machine learning and AI models, while also assessing the effectiveness of our AI products. You will have a direct impact on company performance by developing and scaling evaluation methods that measure service quality across agents and AI assistants, identify opportunities for improvement, and ensure we deliver the right support experience for each merchant segment.

You will collaborate closely with cross-functional partners — including analysts, ML engineers, data scientists, and product managers — to translate business needs into measurable, production-ready ML solutions. Your contributions will help shape the future of our customer support experience and enable SumUp to grow sustainably with a strong customer-first focus.

What you’ll do

Build and improve LLM-based evaluation models (LLM-as-a-Judge) to assess the quality, safety, and effectiveness of AI products (e.g., AI assistant outputs, agent copilots, support automation).

Help design and implement automated QA and evaluation pipelines that enable continuous monitoring and benchmarking of AI product performance at scale.

Contribute to end-to-end model development, from problem framing and data exploration to deployment and monitoring, with guidance and support from the team.

Own the forecasting models and work with WFM to improve the accuracy.

Develop and maintain data pipelines that combine product signals, customer su

Company & Role Analysis

JobSeeker+
Likely perks
Private MedicalPension25+ Days HolidayStock OptionsLearning BudgetFlexible Hours
Culture & working style

Neutral 2–4 sentence summary of what working at this company is like, drawn from public reviews and press coverage. Tone, collaboration style, pace, benefits highlights.

Market salary range

£45,000 – £60,000 (Glassdoor, Levels.fyi, 2025)

Unlock the full analysis for this job
Sign in to unlock →

Similar roles

See more
Skyscanner
London, UK
Full-time
about 18 hours ago

About Skyscanner Everyone loves travelling, but planning is not without its challenges. That's why we've spent 20 years building tools that…

View Job
S&P Global
London, UK
£80,391 – £80,391
Full-time
about 10 hours ago

About the Role: Grade Level (for internal use): 09 The Team: The Collection Platforms & AI team focuses on building ML powered products and…

View Job
Checkout.com
London, UK
£52,924 – £52,924
Full-time
about 10 hours ago

Company Description We’re Checkout.com – you might not know our name, but companies like eBay, ASOS, Klarna, Uber Eats, and Sony do. That mo…

View Job
Checkout.com
London, UK
£49,456 – £49,456
Full-time
about 10 hours ago

Company Description We’re Checkout.com – you might not know our name, but companies like eBay, ASOS, Klarna, Uber Eats, and Sony do. That mo…

View Job
IMS
London, UK
£68,728 – £68,728
Full-time
about 10 hours ago

Company Overview IMS is a leader in connected car and telematics services. We provide services and analytics to insurers, governments, and e…

View Job
Apply NowApply with CV Improver