Search

Provider-neutral evaluation hub (judge::evaluate, judge::cancel, and the internal judge::models::list) that forwards typed Noul, Choice and Score questions to the selected judge-<provider> worker; the default provider is a Console setting seeded from JUDGE_PROVIDER (typesafe). Also resolves worker-defined @<name>(id=…) chat mentions for agents (judge::mentions::resolve and a harness pre-generate hook).

binary·Supported platforms: macOS: arm64, x64 · Linux: arm64, armv7, x64 · Windows: arm64, x64·8 functions·choiceevaluation+4·iii

TypeSafe evaluation (judge-typesafe::evaluate), model listing (judge-typesafe::models::list) and caller-scoped cancellation (judge-typesafe::cancel), with typed usage, provider errors, per-call retries and worker-owned credentials.

binary·Supported platforms: macOS: arm64, x64 · Linux: arm64, armv7, x64 · Windows: arm64, x64·8 functions·choiceevaluation+4·iii

OpenAI Decisions evaluation (judge-openai::evaluate), model listing (judge-openai::models::list) and caller-scoped cancellation (judge-openai::cancel), with typed usage, provider errors, per-call retries and worker-owned credentials.

binary·Supported platforms: macOS: arm64, x64 · Linux: arm64, armv7, x64 · Windows: arm64, x64·8 functions·choiceevaluation+4·iii