llama3-8b-spaetzle-v31 — GGUF

GGUF conversion of cstr/llama3-8b-spaetzle-v31. Spaetzle v31 on Llama-3 8B base.

Files

| File | Size |

|------|------|

| llama3-8b-spaetzle-v31.Q4_K_M.gguf | 4693 MB |

Compatible with llama.cpp and other GGUF runtimes.

Base model: cstr/llama3-8b-spaetzle-v31 — a mergekit merge published by the same maintainer as this repository. It is not a third-party upstream: the maintainer authored that model.
What was done here: format conversion and/or quantisation of that base model only (GGUF). No further training, fine-tuning or merging was applied at this step.
Licence: llama3, inherited through the base model from the models it was built from.
Training data: none was used, added or selected at this conversion step. The base model's card lists the models it was built from; their training content is documented — where it is documented at all — by their respective providers.
Provider status: under Regulation (EU) 2024/1689 this repository makes no provider claim for the conversion step. Any provider obligations attaching to the model itself — including Art. 53(1)(c) copyright policy and Art. 53(1)(d) training-content summary — attach at cstr/llama3-8b-spaetzle-v31, not here.

Question 2

What license applies to cstr/llama3-8b-spaetzle-v31-GGUF?

Accepted Answer

License: llama3. Verify terms on Hugging Face before commercial use.

Question 3

How do I run cstr/llama3-8b-spaetzle-v31-GGUF locally?

Accepted Answer

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Question 4

How much VRAM or disk space does cstr/llama3-8b-spaetzle-v31-GGUF need?

Accepted Answer

Runs locally from ~4.58 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).