Skip to content
Registry

judge-semif

v0.2.4

SemIf provider for the judge hub (judge-semif::evaluate, judge-semif::models::list, judge-semif::cancel) — a frozen open LLM (Qwen3.5-4B GGUF) downloaded from the Hugging Face Hub and run in-process through llama.cpp, answering from the next-token logits of the option letters; picks Metal (macOS), Vulkan (Linux, when a driver is present) or the CPU automatically; no API key or external service.

license: Apache-2.0choiceevaluationgpujudgellama.cpplocalnoulscoresemif

Install

bash
iii trigger compose::add worker=judge-semif

Run in your project with the iii engine running. Exact versions are immutable and digest-pinned.

Functions6

judge-semif::cancel

Function

Signal cancellation of an active evaluation owned by the calling worker; the current batch finishes, later batches are skipped. Requires the same worker replica as the original call.

Request
  • request_idstringrequired1…128 chars
Response
one of (2)
Variant 1
  • cancelledbooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • statusstringrequiredenum error

judge-semif::configuration-id

Function

Returns this worker instance's effective configuration entry ID, without its value.

Request
Empty object
Response
  • idstringrequired

judge-semif::evaluate

Function

Evaluate Noul, Choice and Score questions against arbitrary JSON state with the SemIf model (a frozen GGUF LLM read at the option letters) running inside this worker. Results are atomic; usage counts decoded prompt tokens. No credentials or endpoints are accepted in the request.

Request
  • evaluationsobject[]required1…512 items
    • idstringrequired
    • questionsobjectrequired
    • stateany ofrequired

      Score levels require a description. Unlike instructions, Choice option descriptions and Noul criteria, the provider rejects a null level (HTTP422).

      any of (3)
      Variant 1
      valuestring
      Variant 2
      Empty object
      Variant 3
      itemsunknown[]
  • expires_at_unix_msinteger· uint64min 0
  • modelstring
  • optionsall of
    all of (1)
    Variant 1
    • attempt_timeout_msinteger· uint64min 1

      Bounds each network attempt separately from the whole-call deadline.

  • request_idstring1…128 chars
  • timeout_msinteger· uint64requiredmin 1
Response
one of (2)
Variant 1
  • modelstringrequired
  • resultsobjectrequired
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • http_statusinteger· uint16min 0
  • provider_errorany of
    any of (2)
    Variant 1
    • detailunknown
    • messagestring
    • truncatedboolean
    Variant 2
    valuenull
  • retry_after_msinteger· uint64min 0
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum error

judge-semif::models::list

Function

Describe the SemIf model, loading it if needed (name, pinned revision, device, context window); performs no inference.

Request
  • expires_at_unix_msinteger· uint64min 0
  • optionsall of
    all of (1)
    Variant 1
    • attempt_timeout_msinteger· uint64min 1

      Bounds each network attempt separately from the whole-call deadline.

  • request_idstring1…128 chars
  • timeout_msinteger· uint64min 1
Response
one of (2)
Variant 1
  • modelsobject[]required
    • context_windowinteger· uint32min 0

      Tokens one evaluation row can hold (question, options and state), when the provider has a fixed window. Callers size their states from it.

    • descriptionstringrequired
    • max_optionsinteger· uint32min 0

      Most options one Choice question (or levels one Score) can offer, when the provider has a fixed limit below the contract's 255. Callers size their option groups from it.

    • namestringrequired
    • release_datestringrequired
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum ok
Variant 2
  • codeone ofrequired
    one of (2)
    Variant 1
    valuestringenum invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    Variant 2
    valuestringenum provider_unavailable
  • http_statusinteger· uint16min 0
  • provider_errorany of
    any of (2)
    Variant 1
    • detailunknown
    • messagestring
    • truncatedboolean
    Variant 2
    valuenull
  • retry_after_msinteger· uint64min 0
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum error

judge-semif::on-config-change

Function

Internal: reload SemIf configuration from authoritative storage.

Request
  • idstring

    Configuration id that changed.

Response
  • okbooleanrequired

judge-semif::ui-content

Function

Serve the judge-semif worker's injected console UI assets (content function for its console:script / console:style / console:module triggers).

Request
  • pathstringrequired

    The asset path from the trigger config (e.g. `state/page.js`).

Response
  • contentstringrequired

    The asset source, verbatim.

  • content_typestringrequired

    MIME type the console should serve the asset with.

Triggers0

No triggers registered

Search the registry

Find workers, kits and executables, or jump to a page.