GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Piecrust/Spike-2B-GGUF overview

<p align="center" <img src="https://huggingface.co/Piecrust/Spike 2B GGUF/resolve/main/banner.png" alt="Spike 2B GGUF" width="100%" </p Spike 2B · GGUF Spike i…

gguftool-callingfunction-callingspikeon-devicetext-generationendebase_model:Qwen/Qwen3.5-2Bbase_model:quantized:Qwen/Qwen3.5-2Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~1.19 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
69
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Spike-2B-F16.ggufGGUFF163.52 GBDownload
Spike-2B-Q4_K_M.ggufGGUFQ4_K_M1.19 GBDownload

Model Details

Model IDPiecrust/Spike-2B-GGUF
AuthorPiecrust
Pipelinetext-generation
Licenseapache-2.0
Base modelQwen/Qwen3.5-2B
Last modified2026-07-15T16:41:34.000Z

Model README

---

license: apache-2.0

base_model: Qwen/Qwen3.5-2B

library_name: gguf

pipeline_tag: text-generation

tags:

- gguf

- tool-calling

- function-calling

- spike

- on-device

language:

- en

- de

thumbnail: https://huggingface.co/Piecrust/Spike-2B-GGUF/resolve/main/banner.png

---

<p align="center">

<img src="https://huggingface.co/Piecrust/Spike-2B-GGUF/resolve/main/banner.png" alt="Spike-2B-GGUF" width="100%">

</p>

Spike-2B · GGUF

Spike is the on-device assistant in the Spike AI iOS app.

📱 Get it on the App Store: https://apps.apple.com/app/spike-ai/id6749781844

This model is a LoRA fine-tune of Qwen/Qwen3.5-2B,

specialized for Spike's tool-calling workload: reminders, calendar, Apple Home,

maps, web search/browse, files, code, and the full SSH/agent toolset — in

English and German. It emits Spike's text tool grammar:

tool:<name> {"key":"value"}

> Note on the GGUF: Qwen3.5 is a new hybrid (linear-attention + full-attention)

> architecture. Loading requires a current llama.cpp build with qwen35

> support. For on-device iOS the app ships the MLX build instead.

Files

| File | Use |

|---|---|

| Spike-2B-Q4_K_M.gguf (1.2 GB) | Recommended quant for CPU/GPU serving |

| Spike-2B-F16.gguf (3.8 GB) | Full-precision source for requantizing |

Eval — Spike harness (before → after)

| Metric | Base Qwen3.5-2B | Spike-2B |

|---|---:|---:|

| Tool calls (thinking off) | 39.8% | 99.6% |

| Tool calls (thinking on) | — | 96.8% |

| Vision (image → tool / answer) | 67.5% | 100% |

| Valid JSON on tool calls | ≈64% | 100% |

| Normal-chat tool-leak (lower=better) | — | 0% |

Trained in three stages — text + thinking + general + German (≈22.5k samples), an

800-image vision-replay stage (flyer → calendar, note → reminder, receipt/scene

→ answer), then a conversation-repair stage — so the model keeps its

enable_thinking reasoning and vision, speaks Spike's tool grammar, **and does not

hijack casual chat into tool calls** (normal-chat tool-leak 0%). (Vision is available

in the MLX build; the GGUF text model carries tools + thinking.)

Usage notes

  • Trained on Spike's compact system prompt; use that exact prompt for best results.
  • Supports optional reasoning via the enable_thinking chat-template kwarg.
  • Tool calls are plain text tool:<name> {json} — one per turn.

License

Derivative of Qwen3.5-2B under the Apache 2.0 License.

Run Piecrust/Spike-2B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models