GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

heterodoxin/fastcontext-1.0-4b-sft-apostate-gguf overview

fastcontext 1.0 4b sft apostate — GGUF Join the community: Discord https://discord.gg/NPA7xrATEH GGUF quants of heterodoxin/fastcontext 1.0 4b sft apostate htt…

ggufapostateuncensoredllama.cppbase_model:heterodoxin/fastcontext-1.0-4b-sft-apostatebase_model:quantized:heterodoxin/fastcontext-1.0-4b-sft-apostatelicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~1.67 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
2
Likes
0
Pipeline

Repository Files & Downloads

7 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
fastcontext-1.0-4b-sft-apostate-Q2_K.ggufGGUFQ2_K1.67 GBDownload
fastcontext-1.0-4b-sft-apostate-Q3_K_M.ggufGGUFQ3_K_M2.09 GBDownload
fastcontext-1.0-4b-sft-apostate-Q4_K_M.ggufGGUFQ4_K_M2.53 GBDownload
fastcontext-1.0-4b-sft-apostate-Q5_K_M.ggufGGUFQ5_K_M2.94 GBDownload
fastcontext-1.0-4b-sft-apostate-Q6_K.ggufGGUFQ6_K3.38 GBDownload
fastcontext-1.0-4b-sft-apostate-Q8_0.ggufGGUFQ8_04.37 GBDownload
fastcontext-1.0-4b-sft-apostate-bf16.ggufGGUFBF168.22 GBDownload

Model Details

Model IDheterodoxin/fastcontext-1.0-4b-sft-apostate-gguf
Authorheterodoxin
Pipeline
Licenseapache-2.0
Base modelheterodoxin/fastcontext-1.0-4b-sft-apostate
Last modified2026-06-24T13:44:52.000Z

Model README

---

license: apache-2.0

base_model: heterodoxin/fastcontext-1.0-4b-sft-apostate

tags:

  • gguf
  • apostate
  • uncensored
  • llama.cpp

---

fastcontext-1.0-4b-sft-apostate — GGUF

> Join the community: Discord

GGUF quants of heterodoxin/fastcontext-1.0-4b-sft-apostate, an

Apostate weight-edit uncensored model.

Pick a single quant or the full-quality bf16.

Quants

| file | quant | notes |

|---|---|---|

| fastcontext-1.0-4b-sft-apostate-bf16.gguf | BF16 | full quality (default) |

| fastcontext-1.0-4b-sft-apostate-Q2_K.gguf | Q2_K | smallest, lowest quality |

| fastcontext-1.0-4b-sft-apostate-Q3_K_M.gguf | Q3_K_M | small |

| fastcontext-1.0-4b-sft-apostate-Q4_K_M.gguf | Q4_K_M | recommended balance |

| fastcontext-1.0-4b-sft-apostate-Q5_K_M.gguf | Q5_K_M | higher quality |

| fastcontext-1.0-4b-sft-apostate-Q6_K.gguf | Q6_K | near-lossless |

| fastcontext-1.0-4b-sft-apostate-Q8_0.gguf | Q8_0 | highest quality quant |

Install one quant (Ollama, easiest)

ollama run hf.co/heterodoxin/fastcontext-1.0-4b-sft-apostate-gguf:Q4_K_M      # any quant tag above, or BF16

Install one quant (llama.cpp / manual)

huggingface-cli download heterodoxin/fastcontext-1.0-4b-sft-apostate-gguf fastcontext-1.0-4b-sft-apostate-Q4_K_M.gguf --local-dir .
./llama-cli -m fastcontext-1.0-4b-sft-apostate-Q4_K_M.gguf -p "your prompt"

Swap Q4_K_M for any quant in the table, or fastcontext-1.0-4b-sft-apostate-bf16.gguf for full quality.

Run heterodoxin/fastcontext-1.0-4b-sft-apostate-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models