Type a query, then narrow it down by type, tag or author.
llama.cpp server (llama-server) Chat Completions provider worker; implements provider::llamacpp::stream and provider::llamacpp::refresh_models behind llm-router.
decider provider for the judge hub (judge-decider::evaluate, judge-decider::models::list, judge-decider::cancel) — decider-4b v2 (a Qwen3.5-4B-Base fine-tune for typed decisions, GGUF) downloaded from the Hugging Face Hub and run in-process through llama.cpp, answering from the next-token logits of the option labels at its fitted temperature; picks Metal (macOS), Vulkan (Linux, when a driver is present) or the CPU automatically; no API key or external service.
clef provider for the judge hub (judge-clef::evaluate, judge-clef::models::list, judge-clef::cancel) — Cloudflare's Clef-Flash decision model (a Qwen3.5-9B backbone and its joint schema head in one GGUF) downloaded from the Hugging Face Hub and run in-process through llama.cpp's clef architecture, deciding every question of an evaluation together in one forward pass; picks Metal (macOS), Vulkan (Linux x86_64, when a driver is present) or the CPU automatically; no API key or external service.
SemIf provider for the judge hub (judge-semif::evaluate, judge-semif::models::list, judge-semif::cancel) — a frozen open LLM (Qwen3.5-4B GGUF) downloaded from the Hugging Face Hub and run in-process through llama.cpp, answering from the next-token logits of the option letters; picks Metal (macOS), Vulkan (Linux, when a driver is present) or the CPU automatically; no API key or external service.
Find workers, kits and executables, or jump to a page.
