---

license: apache-2.0

library_name: gguf

base_model: fableforge-ai/ShellWhisperer-1.5B

base_model_relation: quantized

tags:

• gguf
• fableforge
• shellwhisperer
• 1.5b
• llama.cpp
• lm-studio
• ollama
• text-generation
• uncensored
• agent
• tool-use
• en

pipeline_tag: text-generation

---

ShellWhisperer-1.5B-GGUF

GGUF quantizations of fableforge-ai/ShellWhisperer-1.5B, a 1.5B parameter instruction-tuned model optimized for shell command generation, agentic tool use, and uncensored reasoning.

Available Quants

| Quant | File |

|---|---|

| F16 | shellwhisperer-1.5b-f16.gguf |

| Q8_0 | shellwhisperer-1.5b-Q8_0.gguf |

| Q6_K | shellwhisperer-1.5b-Q6_K.gguf |

| Q5_K_M | shellwhisperer-1.5b-Q5_K_M.gguf |

| Q4_K_M | shellwhisperer-1.5b-Q4_K_M.gguf |

| Q4_0 | shellwhisperer-1.5b-Q4_0.gguf |

| Q3_K_M | shellwhisperer-1.5b-Q3_K_M.gguf |

| Q2_K | shellwhisperer-1.5b-Q2_K.gguf |

| IQ4_XS | shellwhisperer-1.5b-IQ4_XS.gguf |

| IQ3_XXS | shellwhisperer-1.5b-IQ3_XXS.gguf |

| IQ2_XXS | shellwhisperer-1.5b-IQ2_XXS.gguf |

| IQ1_S | shellwhisperer-1.5b-IQ1_S.gguf |

Usage

llama.cpp

git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
make -j
./main -m shellwhisperer-1.5b-Q4_K_M.gguf -p "Generate a bash script to..." -n 512

Ollama

ollama run hf.co/fableforge-ai/ShellWhisperer-1.5B-GGUF:Q4_K_M

LM Studio

Search for "ShellWhisperer" in the LM Studio search panel.

---

🔗 Related models

• 🧠 Base model (safetensors): ShellWhisperer-1.5B