Disagreement
A detected disagreement between model responses.
Usage
Disagreement(
description,
models,
severity="moderate",
)Parameters
description: str-
Human-readable description of the disagreement.
models: tuple[str, …]-
The models involved in the disagreement.
severity: str = "moderate"-
Severity level:
"minor"(stylistic),"moderate"(factual nuance),"major"(contradictory claims).