Skip to content
Registry

judge-decider

v0.2.4

decider provider for the judge hub (judge-decider::evaluate, judge-decider::models::list, judge-decider::cancel) — decider-4b v2 (a Qwen3.5-4B-Base fine-tune for typed decisions, GGUF) downloaded from the Hugging Face Hub and run in-process through llama.cpp, answering from the next-token logits of the option labels at its fitted temperature; picks Metal (macOS), Vulkan (Linux, when a driver is present) or the CPU automatically; no API key or external service.

license: Apache-2.0choicedeciderevaluationgpujudgellama.cpplocalnoulscore

Install

bash
iii trigger compose::add worker=judge-decider

Run in your project with the iii engine running. Exact versions are immutable and digest-pinned.

Functions6

judge-decider::cancel

Function

Signal cancellation of an active evaluation owned by the calling worker; the current batch finishes, later batches are skipped. Requires the same worker replica as the original call.

Request
  • request_idstringrequired1…128 chars
Response
one of (2)
Variant 1
  • cancelledbooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • statusstringrequiredenum error

judge-decider::configuration-id

Function

Returns this worker instance's effective configuration entry ID, without its value.

Request
Empty object
Response
  • idstringrequired

judge-decider::evaluate

Function

Evaluate Noul, Choice and Score questions against arbitrary JSON state with decider-4b (a GGUF LLM fine-tuned for typed decisions, read at the option labels) running inside this worker. Results are atomic; usage counts decoded prompt tokens. No credentials or endpoints are accepted in the request.

Request
  • evaluationsobject[]required1…512 items
    • idstringrequired
    • questionsobjectrequired
    • stateany ofrequired

      Score levels require a description. Unlike instructions, Choice option descriptions and Noul criteria, the provider rejects a null level (HTTP422).

      any of (3)
      Variant 1
      valuestring
      Variant 2
      Empty object
      Variant 3
      itemsunknown[]
  • expires_at_unix_msinteger· uint64min 0
  • modelstring
  • optionsall of
    all of (1)
    Variant 1
    • attempt_timeout_msinteger· uint64min 1

      Bounds each network attempt separately from the whole-call deadline.

  • request_idstring1…128 chars
  • timeout_msinteger· uint64requiredmin 1
Response
one of (2)
Variant 1
  • modelstringrequired
  • resultsobjectrequired
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • http_statusinteger· uint16min 0
  • provider_errorany of
    any of (2)
    Variant 1
    • detailunknown
    • messagestring
    • truncatedboolean
    Variant 2
    valuenull
  • retry_after_msinteger· uint64min 0
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum error

judge-decider::models::list

Function

Describe the decider model, loading it if needed (name, pinned revision, device, context window); performs no inference.

Request
  • expires_at_unix_msinteger· uint64min 0
  • optionsall of
    all of (1)
    Variant 1
    • attempt_timeout_msinteger· uint64min 1

      Bounds each network attempt separately from the whole-call deadline.

  • request_idstring1…128 chars
  • timeout_msinteger· uint64min 1
Response
one of (2)
Variant 1
  • modelsobject[]required
    • context_windowinteger· uint32min 0

      Tokens one evaluation row can hold (question, options and state), when the provider has a fixed window. Callers size their states from it.

    • descriptionstringrequired
    • max_optionsinteger· uint32min 0

      Most options one Choice question (or levels one Score) can offer, when the provider has a fixed limit below the contract's 255. Callers size their option groups from it.

    • namestringrequired
    • release_datestringrequired
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • http_statusinteger· uint16min 0
  • provider_errorany of
    any of (2)
    Variant 1
    • detailunknown
    • messagestring
    • truncatedboolean
    Variant 2
    valuenull
  • retry_after_msinteger· uint64min 0
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum error

judge-decider::on-config-change

Function

Internal: reload decider configuration from authoritative storage.

Request
  • idstring

    Configuration id that changed.

Response
  • okbooleanrequired

judge-decider::ui-content

Function

Serve the judge-decider worker's injected console UI assets (content function for its console:script / console:style / console:module triggers).

Request
  • pathstringrequired

    The asset path from the trigger config (e.g. `state/page.js`).

Response
  • contentstringrequired

    The asset source, verbatim.

  • content_typestringrequired

    MIME type the console should serve the asset with.

Triggers0

No triggers registered

Search the registry

Find workers, kits and executables, or jump to a page.