Model Intelligence Sheet
ApocalypseParty/G4-31B-SFT-v6-4-gguf overview
ApocalypseParty/G4-31B-SFT-v6-4-gguf GGUF downloads for local AI inference with guIDE.
Runs locally from ~13.43 GB disk (16 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
8 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| G4-31B-SFT-v6-4-IQ3_M.gguf | GGUF | IQ3_M | 13.43 GB | Download |
| G4-31B-SFT-v6-4-IQ4_XS.gguf | GGUF | IQ4_XS | 15.59 GB | Download |
| G4-31B-SFT-v6-4-Q3_K_M.gguf | GGUF | Q3_K_M | 14.24 GB | Download |
| G4-31B-SFT-v6-4-Q4_K_M.gguf | GGUF | Q4_K_M | 17.40 GB | Download |
| G4-31B-SFT-v6-4-Q5_K_M.gguf | GGUF | Q5_K_M | 20.35 GB | Download |
| G4-31B-SFT-v6-4-Q6_K.gguf | GGUF | Q6_K | 23.47 GB | Download |
| G4-31B-SFT-v6-4-Q8_0.gguf | GGUF | Q8_0 | 30.39 GB | Download |
| G4-31B-SFT-v6-4-bf16.gguf | GGUF | BF16 | 57.20 GB | Download |
Model Details
| Model ID | ApocalypseParty/G4-31B-SFT-v6-4-gguf |
|---|---|
| Author | ApocalypseParty |
| Pipeline | — |
| License | — |
| Base model | — |
| Last modified | 2026-06-24T14:53:34.000Z |
Run ApocalypseParty/G4-31B-SFT-v6-4-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models