Skip to content
Registry

judge-clef

v0.2.2

clef provider for the judge hub (judge-clef::evaluate, judge-clef::models::list, judge-clef::cancel) — Cloudflare's Clef-Flash decision model (a Qwen3.5-9B backbone and its joint schema head in one GGUF) downloaded from the Hugging Face Hub and run in-process through llama.cpp's clef architecture, deciding every question of an evaluation together in one forward pass; picks Metal (macOS), Vulkan (Linux x86_64, when a driver is present) or the CPU automatically; no API key or external service.

license: Apache-2.0choiceclefevaluationgpujudgellama.cpplocalnoulscore

Install

bash
iii trigger compose::add worker=judge-clef

Run in your project with the iii engine running. Exact versions are immutable and digest-pinned.

Functions6

judge-clef::cancel

Function

Signal cancellation of an active evaluation owned by the calling worker; an evaluation still waiting for the model is skipped, as are later ones (a forward pass already running finishes first). Requires the same worker replica as the original call.

Request
  • request_idstringrequired1…128 chars
Response
one of (2)
Variant 1
  • cancelledbooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • statusstringrequiredenum error

judge-clef::configuration-id

Function

Returns this worker instance's effective configuration entry ID, without its value.

Request
Empty object
Response
  • idstringrequired

judge-clef::evaluate

Function

Evaluate Noul, Choice and Score questions against arbitrary JSON state with Clef-Flash (Cloudflare's joint decision model: its backbone and joint schema head decide every question of an evaluation together, in one llama.cpp forward pass) running inside this worker. Results are atomic; usage counts prompt tokens. No credentials or endpoints are accepted in the request.

Request
  • evaluationsobject[]required1…512 items
    • idstringrequired
    • questionsobjectrequired
    • stateany ofrequired

      Score levels require a description. Unlike instructions, Choice option descriptions and Noul criteria, the provider rejects a null level (HTTP422).

      any of (3)
      Variant 1
      valuestring
      Variant 2
      Empty object
      Variant 3
      itemsunknown[]
  • expires_at_unix_msinteger· uint64min 0
  • modelstring
  • optionsall of
    all of (1)
    Variant 1
    • attempt_timeout_msinteger· uint64min 1

      Bounds each network attempt separately from the whole-call deadline.

  • request_idstring1…128 chars
  • timeout_msinteger· uint64requiredmin 1
Response
one of (2)
Variant 1
  • modelstringrequired
  • resultsobjectrequired
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • http_statusinteger· uint16min 0
  • provider_errorany of
    any of (2)
    Variant 1
    • detailunknown
    • messagestring
    • truncatedboolean
    Variant 2
    valuenull
  • retry_after_msinteger· uint64min 0
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum error

judge-clef::models::list

Function

Describe the Clef model, loading it if needed (name, pinned revision, device, context window, maximum options); performs no inference.

Request
  • expires_at_unix_msinteger· uint64min 0
  • optionsall of
    all of (1)
    Variant 1
    • attempt_timeout_msinteger· uint64min 1

      Bounds each network attempt separately from the whole-call deadline.

  • request_idstring1…128 chars
  • timeout_msinteger· uint64min 1
Response
one of (2)
Variant 1
  • modelsobject[]required
    • context_windowinteger· uint32min 0

      Tokens one evaluation row can hold (question, options and state), when the provider has a fixed window. Callers size their states from it.

    • descriptionstringrequired
    • max_optionsinteger· uint32min 0

      Most options one Choice question (or levels one Score) can offer, when the provider has a fixed limit below the contract's 255. Callers size their option groups from it.

    • namestringrequired
    • release_datestringrequired
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • http_statusinteger· uint16min 0
  • provider_errorany of
    any of (2)
    Variant 1
    • detailunknown
    • messagestring
    • truncatedboolean
    Variant 2
    valuenull
  • retry_after_msinteger· uint64min 0
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum error

judge-clef::on-config-change

Function

Internal: reload clef configuration from authoritative storage.

Request
  • idstring

    Configuration id that changed.

Response
  • okbooleanrequired

judge-clef::ui-content

Function

Serve the judge-clef worker's injected console UI assets (content function for its console:script / console:style / console:module triggers).

Request
  • pathstringrequired

    The asset path from the trigger config (e.g. `state/page.js`).

Response
  • contentstringrequired

    The asset source, verbatim.

  • content_typestringrequired

    MIME type the console should serve the asset with.

Triggers0

No triggers registered

Search the registry

Find workers, kits and executables, or jump to a page.