squ11z1/Mythos-nano-GGUF overview
Mythos nano — GGUF GGUF quantizations of squ11z1/Mythos nano https://huggingface.co/squ11z1/Mythos nano 3B reasoning model, Qwen2 class for llama.cpp / Ollama …
Runs locally from ~1.19 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| mythos-nano-Q2_K.gguf | GGUF | Q2_K | 1.19 GB | Download |
| mythos-nano-Q3_K_L.gguf | GGUF | Q3_K_L | 1.59 GB | Download |
| mythos-nano-Q3_K_M.gguf | GGUF | Q3_K_M | 1.48 GB | Download |
| mythos-nano-Q3_K_S.gguf | GGUF | Q3_K_S | 1.35 GB | Download |
| mythos-nano-Q4_K_M.gguf | GGUF | Q4_K_M | 1.80 GB | Download |
| mythos-nano-Q4_K_S.gguf | GGUF | Q4_K_S | 1.71 GB | Download |
| mythos-nano-Q5_K_M.gguf | GGUF | Q5_K_M | 2.07 GB | Download |
| mythos-nano-Q5_K_S.gguf | GGUF | Q5_K_S | 2.02 GB | Download |
| mythos-nano-Q6_K.gguf | GGUF | Q6_K | 2.36 GB | Download |
| mythos-nano-Q8_0.gguf | GGUF | Q8_0 | 3.06 GB | Download |
| mythos-nano-f16.gguf | GGUF | F16 | 5.75 GB | Download |
Model Details
| Model ID | squ11z1/Mythos-nano-GGUF |
|---|---|
| Author | squ11z1 |
| Pipeline | text-generation |
| License | mit |
| Base model | squ11z1/Mythos-nano |
| Last modified | 2026-07-14T11:13:20.000Z |
Model README
---
license: mit
base_model:
- squ11z1/Mythos-nano
base_model_relation: quantized
pipeline_tag: text-generation
tags:
- gguf
- reasoning
- math
- code
- qwen2
- mythos-nano
---
Mythos-nano — GGUF
GGUF quantizations of squ11z1/Mythos-nano
(3B reasoning model, Qwen2-class) for llama.cpp / Ollama / LM Studio.
> ⚠️ Abliterated (uncensored): the refusal direction has been removed — this model will
> not decline requests a safety-tuned model normally would. Use responsibly, at your own risk.
> 🚨 Not trained for tool-calling / agentic coding — best on competition-style math & code.
Quants
| File | Quant | Size | Notes |
|---|---|---|---|
| mythos-nano-Q2_K.gguf | Q2_K | 1.27 GB | smallest, lowest quality |
| mythos-nano-Q3_K_S.gguf | Q3_K_S | 1.45 GB | |
| mythos-nano-Q3_K_M.gguf | Q3_K_M | 1.59 GB | |
| mythos-nano-Q3_K_L.gguf | Q3_K_L | 1.71 GB | |
| mythos-nano-Q4_K_S.gguf | Q4_K_S | 1.83 GB | |
| mythos-nano-Q4_K_M.gguf | Q4_K_M | 1.93 GB | recommended balance |
| mythos-nano-Q5_K_S.gguf | Q5_K_S | 2.17 GB | |
| mythos-nano-Q5_K_M.gguf | Q5_K_M | 2.22 GB | high quality |
| mythos-nano-Q6_K.gguf | Q6_K | 2.54 GB | near-lossless |
| mythos-nano-Q8_0.gguf | Q8_0 | 3.29 GB | ~lossless |
| mythos-nano-f16.gguf | F16 | 6.18 GB | full precision |
Usage
# llama.cpp
llama-cli -hf squ11z1/Mythos-nano-GGUF:Q4_K_M -p "Find all integer solutions of x^2 - y^2 = 12."
# Ollama
ollama run hf.co/squ11z1/Mythos-nano-GGUF:Q4_K_M
Recommended sampling: temperature 0.6–1.0. This is a reasoning model — expect long
chain-of-thought before the final answer.
License
MIT.
Run squ11z1/Mythos-nano-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models