EvalCase

A single evaluation test case.

Usage

Source

EvalCase(
    query,
    context="",
    tags=(),
)

Parameters

query: str

The user message to send to the bot.

context: str = ""

Optional context about what a good response should contain.

tags: tuple[str, …] = ()
Optional tags for filtering/grouping results.