Business AI & JouleSession

JW209 | Evaluating AI That Works: SAP's Eval Framework for Joule

Thu, 19 Nov 2026 · 3:45 PM – 4:25 PMLevel 4 - Expo - Demo Area 1a
Liam Mischewski

Liam Mischewski

Innovation Architect · SAP

Working inside the ANZ Customer Advisory team to bring our customers' innovative visions to life utilizing the latest advancements within the SAP Business Technology Platform.

The session

About this session

How do you know your AI assistant is actually good? Introducing SAP's evaluation framework for Joule – how LLM responses are scored, how evals validate agent behavior for Lines of Business and customers, and how results feed back into harness and skill improvement. Essential for teams doing QA, LOB integration, or extending Joule to new domains.

Business AI & Joule

More sessions you'll find valuable

Business AI & Joule

JW129 / JW128 | Explore AI-Native Experiences and Agents in Joule Work

Aryan Raj Sinha

Aryan Raj Sinha

Platform Architecture & Adoption, Office of the CTO · SAP

View session details
Business AI & Joule

JW300 | Designing with Intelligence: Joule Harness, UX & Composition

Thorsten Freitag

Thorsten Freitag

Chief Innovation Architect · SAP

View session details
PlatformsApplication Development & AutomationBusiness AI & Joule

Architecting AI Agents with Joule and SAP BTP

Steven Chua

Steven Chua

Enterprise Architecture Advisory · SAP

View session details