GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

squ11z1/Mythos-nano-GGUF overview

Mythos nano — GGUF GGUF quantizations of squ11z1/Mythos nano https://huggingface.co/squ11z1/Mythos nano 3B reasoning model, Qwen2 class for llama.cpp / Ollama …

ggufreasoningmathcodeqwen2mythos-nanotext-generationbase_model:squ11z1/Mythos-nanobase_model:quantized:squ11z1/Mythos-nanolicense:mitendpoints_compatibleregion:usconversational

Runs locally from ~1.19 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
2,974
Likes
7
Pipeline
text-generation
Author

Repository Files & Downloads

11 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
mythos-nano-Q2_K.ggufGGUFQ2_K1.19 GBDownload
mythos-nano-Q3_K_L.ggufGGUFQ3_K_L1.59 GBDownload
mythos-nano-Q3_K_M.ggufGGUFQ3_K_M1.48 GBDownload
mythos-nano-Q3_K_S.ggufGGUFQ3_K_S1.35 GBDownload
mythos-nano-Q4_K_M.ggufGGUFQ4_K_M1.80 GBDownload
mythos-nano-Q4_K_S.ggufGGUFQ4_K_S1.71 GBDownload
mythos-nano-Q5_K_M.ggufGGUFQ5_K_M2.07 GBDownload
mythos-nano-Q5_K_S.ggufGGUFQ5_K_S2.02 GBDownload
mythos-nano-Q6_K.ggufGGUFQ6_K2.36 GBDownload
mythos-nano-Q8_0.ggufGGUFQ8_03.06 GBDownload
mythos-nano-f16.ggufGGUFF165.75 GBDownload

Model Details

Model IDsqu11z1/Mythos-nano-GGUF
Authorsqu11z1
Pipelinetext-generation
Licensemit
Base modelsqu11z1/Mythos-nano
Last modified2026-07-14T11:13:20.000Z

Model README

---

license: mit

base_model:

  • squ11z1/Mythos-nano

base_model_relation: quantized

pipeline_tag: text-generation

tags:

  • gguf
  • reasoning
  • math
  • code
  • qwen2
  • mythos-nano

---

Mythos-nano — GGUF

GGUF quantizations of squ11z1/Mythos-nano

(3B reasoning model, Qwen2-class) for llama.cpp / Ollama / LM Studio.

> ⚠️ Abliterated (uncensored): the refusal direction has been removed — this model will

> not decline requests a safety-tuned model normally would. Use responsibly, at your own risk.

> 🚨 Not trained for tool-calling / agentic coding — best on competition-style math & code.

Quants

| File | Quant | Size | Notes |

|---|---|---|---|

| mythos-nano-Q2_K.gguf | Q2_K | 1.27 GB | smallest, lowest quality |

| mythos-nano-Q3_K_S.gguf | Q3_K_S | 1.45 GB | |

| mythos-nano-Q3_K_M.gguf | Q3_K_M | 1.59 GB | |

| mythos-nano-Q3_K_L.gguf | Q3_K_L | 1.71 GB | |

| mythos-nano-Q4_K_S.gguf | Q4_K_S | 1.83 GB | |

| mythos-nano-Q4_K_M.gguf | Q4_K_M | 1.93 GB | recommended balance |

| mythos-nano-Q5_K_S.gguf | Q5_K_S | 2.17 GB | |

| mythos-nano-Q5_K_M.gguf | Q5_K_M | 2.22 GB | high quality |

| mythos-nano-Q6_K.gguf | Q6_K | 2.54 GB | near-lossless |

| mythos-nano-Q8_0.gguf | Q8_0 | 3.29 GB | ~lossless |

| mythos-nano-f16.gguf | F16 | 6.18 GB | full precision |

Usage

# llama.cpp
llama-cli -hf squ11z1/Mythos-nano-GGUF:Q4_K_M -p "Find all integer solutions of x^2 - y^2 = 12."
# Ollama
ollama run hf.co/squ11z1/Mythos-nano-GGUF:Q4_K_M

Recommended sampling: temperature 0.6–1.0. This is a reasoning model — expect long

chain-of-thought before the final answer.

License

MIT.

Run squ11z1/Mythos-nano-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models