Inference library / PRODUCT DOSSIER

llama.cpp

C/C++ inference library and server with GGUF models and selectable hardware backends.

Investigation: Which local model runtime fits a 32GB or 64GB Mac? →

Official website ↗Explore in graph →13 cited claims ↓

Self-managed local build and server; pin compiled backends and model files. · Open source · MIT runtime source; model weights have separate licensesRevision 2026-09-15.1 · unreviewedNeeds recheck · recheck 2026-10-150 attestations · checked 2026-09-15

What we do not know yet · 2 open gaps

Which pinned model, quantization, context length and runtime versions fit the selected Mac?
What are measured latency, throughput, peak memory and swap under one and four concurrent requests?

Applies to: Repository revision 38a5b42d9a3e82e0a586bcd1caed121f36c87a73; living documentation separately dated. · Self-managed local build and server; pin compiled backends and model files.

Applicability, 2 recheck triggers & verification plan

Applicability

Repository revision 38a5b42d9a3e82e0a586bcd1caed121f36c87a73; living documentation separately dated.

Self-managed local build and server; pin compiled backends and model files.

Excludes: Runtime verification and performance rankings; Model weights license or quality evaluation; Cloud inference, remote hosts and external tools; Unlisted model architectures, builds and hardware

Recheck when

Runtime, bundled engine, backend, model format or license changes.
Documentation changes affecting the cited configuration.

Needs recheck · due 2026-10-15

Verification plan

Choose hardware and obtain explicit approval for installations, downloads and execution resources.
Pin runtime and engine versions, model artifact hashes, tokenizer, template, quantization and inference settings.
Run the local-model-mac investigation with synthetic prompts and capture raw measurements; do not record documentation as execution.

Provenance & review

Testedknowhow model runtime research

Commissioned by a Nimbalyst maintainer. Documentation synthesis; no independent review or product execution.

Revision 2026-09-15.1 · unreviewed · checked 2026-09-15

0 attestations · Content: Unlicensed prototype; redistribution decision pending

Capability claims · 13 / 14 sourced

Standing condition: these are documentation claims at the source capture date, with outcome “claimed”; no runtime execution is recorded. Dossier applicability and limitations apply throughout. Expand a row for its statement, specific scope and contradictions. Numbered citations resolve to the source locator and capture date below. Missing evidence means Unknown, not No. Sources are unpinned unless marked “Pinned”; this marks source stability, not stronger support or runtime verification. Reuse counts refer to claims in the full dossier; repeated citations do not represent independent sources.

Yes Documented within scope Partial Limited form of the feature No Explicit evidence of absence Unknown No evidence recorded. These are support assessments, not quality scores or runtime verification.