Munich Rubyshift logo

Slug: testing-llm-agent-conversations-with-rspec-agents

Title: Testing LLM Agent Conversations with rspec-agents

Speakers:

Event: Meetup 2026-09-24

Position: 1

Description:

LLM-based agents present unique challenges in terms of validation. The indeterminacy of their outputs makes it impossible to use traditional deterministic assertions. This talk presents the rspec-agents plugin that uses simulated conversations along with rubric-based checks to evaluate the performance of these agents.

Slides url:

Kind: talk

Announced on:

Language: English

Back to all talks