AI/ML Applied Data Scientist

We help the world run better

At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

Summary

We're hiring an experienced AI/ML Scientist to join our newly formed Foundation Model team in Newport Beach. This team sits at the forefront of SAP's cloud transformation, building specialized foundation models and AI agents that accelerate our customers' data transformation journeys. We own the full stack: continued pretraining on SAP data, fine-tuning for domain-specific tasks, and the agentic workflows that bring these models into SAP products.

You'll partner closely with our pretraining and fine-tuning leads, teams in Europe and India, and early-adopter customers.

What You'll Do

Model Development: Oversee the development, fine-tuning, and integration of foundation models into SAP solutions to streamline cloud transformation journeys.

Build agents and agentic workflows: Design multi-step, tool-using agents (single-agent and multi-agent) that solve real SAP business problems, planning, tool calling, memory, reflection, and human-in-the-loop patterns.

Evaluate rigorously: Build offline and online evaluation harnesses, task success, trajectory quality, tool-call accuracy, groundedness, and regression testing. Turn production failures into eval cases that gate deployment.

Observe and improve: Instrument agents with tracing, session and span capture, and automated scoring. Close the loop between production signals and development (trace → eval → fix).

Collaboration: Engage with stakeholders in different teams at SAP as well as early adopter customers and research collaborations.

What You Bring

Education: BS, MS, in Computer Science, ML, Data Science, or a related field.

Experience: 3+ years of experience in data science, with at least 1 year hands-on with LLMs and agents in production or near-production settings.

Core Technical Skills

Strong Python; solid software engineering fundamentals: testing, version control, modularity, async.

Deep learning frameworks: PyTorch (primary) and familiarity with fine-tuning and PEFT methods (LoRA, QLoRA).

LLM application development: prompting, structured outputs, function and tool calling, context management.

Experience with LangGraph, Langfuse, MLFlow/W&B etc.

Nice to have

Familiarity with continued pretraining, fine-tuning pipelines (SFT, DPO, RLHF), or inference optimization (vLLM, TensorRT-LLM, quantization).

Experience running human-in-the-loop annotation workflows

Meet your team

The Foundation Model team is pioneering AI innovations within SAP, as part of the Generative AI foundation within Business AI at SAP. We build and refine our own domain-specialized foundation models on SAP business data through continued pretraining and fine-tuning, and we build the agentic layer that brings these models into SAP products. By joining our team, you'll help shape the future of AI at SAP and drive meaningful advances in how enterprise software gets transformed.

Bring out your best

SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion

SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to co