Model Intelligence Sheet
56m/Dumb-1.2-RC1-GGUF overview
56m/Dumb 1.2 RC1 GGUF This model contains GGUF format model files for 56m/Dumb 1.2 RC1 https://huggingface.co/56m/Dumb 1.2 RC1 . Available Quants The following…
Runs locally from ~29.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
10 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Dumb-1.2-RC1-Q4_0.gguf | GGUF | Q4_0 | 29.3 MB | Download |
| Dumb-1.2-RC1-Q4_K_M.gguf | GGUF | Q4_K_M | 31.3 MB | Download |
| Dumb-1.2-RC1-Q4_K_S.gguf | GGUF | Q4_K_S | 30.8 MB | Download |
| Dumb-1.2-RC1-Q5_0.gguf | GGUF | Q5_0 | 31.2 MB | Download |
| Dumb-1.2-RC1-Q5_K_M.gguf | GGUF | Q5_K_M | 32.2 MB | Download |
| Dumb-1.2-RC1-Q5_K_S.gguf | GGUF | Q5_K_S | 31.9 MB | Download |
| Dumb-1.2-RC1-Q6_K.gguf | GGUF | Q6_K | 35.9 MB | Download |
| Dumb-1.2-RC1-Q8_0.gguf | GGUF | Q8_0 | 36.8 MB | Download |
| Dumb-1.2-RC1-bf16.gguf | GGUF | BF16 | 67.7 MB | Download |
| Dumb-1.2-RC1-f16.gguf | GGUF | F16 | 67.7 MB | Download |
Model Details
Model README
---
license: apache-2.0
datasets:
- HuggingFaceFW/fineweb-edu
- HuggingFaceTB/cosmopedia
language:
- en
base_model: 56m/Dumb-1.2-RC1
library_name: transformers
tags:
- llama-cpp
- gguf-my-repo
---
56m/Dumb-1.2-RC1-GGUF
This model contains GGUF format model files for 56m/Dumb-1.2-RC1.
Available Quants
The following files were generated and uploaded to this repo:
Q4_0, Q4_K_S, Q4_K_M, Q5_0, Q5_K_S, Q5_K_M, Q6_K, Q8_0, f16, bf16
Use with llama.cpp
CLI:
llama-cli --hf-repo 56m/Dumb-1.2-RC1-GGUF --hf-file Dumb-1.2-RC1-Q4_K_M.gguf -p "The meaning to life and the universe is"Server:
llama-server --hf-repo 56m/Dumb-1.2-RC1-GGUF --hf-file Dumb-1.2-RC1-Q4_K_M.gguf -c 2048Or ollama
CLI:
ollama run https://hf.co/56m/Dumb-1.2-RC1-GGUF:Q4_K_MRun 56m/Dumb-1.2-RC1-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models