GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Piecrust/Spike-9B-GGUF overview

<p align="center" <img src="https://huggingface.co/Piecrust/Spike 9B GGUF/resolve/main/banner.png" alt="Spike 9B GGUF" width="100%" </p Spike 9B · GGUF Spike i…

gguftool-callingfunction-callingspiketext-generationendebase_model:Qwen/Qwen3.5-9Bbase_model:quantized:Qwen/Qwen3.5-9Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~5.24 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Spike-9B-F16.ggufGGUFF1616.69 GBDownload
Spike-9B-Q4_K_M.ggufGGUFQ4_K_M5.24 GBDownload

Model Details

Model IDPiecrust/Spike-9B-GGUF
AuthorPiecrust
Pipelinetext-generation
Licenseapache-2.0
Base modelQwen/Qwen3.5-9B
Last modified2026-07-15T16:41:21.000Z

Model README

---

license: apache-2.0

base_model: Qwen/Qwen3.5-9B

library_name: gguf

pipeline_tag: text-generation

tags:

- gguf

- tool-calling

- function-calling

- spike

language:

- en

- de

thumbnail: https://huggingface.co/Piecrust/Spike-9B-GGUF/resolve/main/banner.png

---

<p align="center">

<img src="https://huggingface.co/Piecrust/Spike-9B-GGUF/resolve/main/banner.png" alt="Spike-9B-GGUF" width="100%">

</p>

Spike-9B · GGUF

Spike is the assistant in the Spike AI iOS app. This is the largest Spike tool model — a server-class 9B for CPU/GPU serving via llama.cpp (a current build with qwen35 support).

📱 Get it on the App Store: https://apps.apple.com/app/spike-ai/id6749781844

A LoRA fine-tune of Qwen/Qwen3.5-9B (a vision-language

model), specialized for Spike's tool-calling — reminders, calendar, Apple Home, maps, web, files,

code, and the SSH/agent toolset — while staying a natural conversationalist. English + German.

Tool grammar: tool:<name> {json}.

Files

Spike-9B-Q4_K_M.gguf (≈5.3 GB) + Spike-9B-F16.gguf (≈17 GB source for requantizing).

> Qwen3.5 is a new hybrid (linear-attention + full-attention) architecture; an MLX build is also available for Apple silicon.

Eval — Spike harness (base Qwen3.5-9B → Spike-9B)

| Metric | Base | Spike-9B |

|---|---:|---:|

| Tool calls · thinking-off | 52.0% | 99.8% |

| Tool calls · thinking-on | — | 99.8% |

| Vision (image → tool / answer) | 72.5% | 100% |

| Normal-chat tool-leak (lower=better) | 1.6% | 0% |

Trained text+thinking+German, then a vision-replay stage, then a conversation-repair stage

(distilled base-model chat + contrastive tool/vision replay) so it keeps enable_thinking

reasoning and vision, tool-calls at 99.8%, and does not hijack casual chat into tool calls.

> The Vision row is the fine-tune's image → tool / answer ability, exposed by the MLX build; this GGUF is text-only (tools + thinking).

Usage

  • Trained on Spike's compact system prompt; use that exact prompt.
  • Optional reasoning via the enable_thinking chat-template kwarg.
  • One text tool call per turn: tool:<name> {json}.

License

Derivative of Qwen3.5-9B under the Apache 2.0 License.

Run Piecrust/Spike-9B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models