Search

llama.cpp server (llama-server) Chat Completions provider worker; implements provider::llamacpp::stream and provider::llamacpp::refresh_models behind llm-router.

binary·Supported platforms: macOS: arm64, x64 · Linux: arm64, armv7, x64 · Windows: arm64, x64·6 functions·llama.cppllm+3·iii