GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

Hanno-Labs author hub

Running Bosun locally GGUF These are GGUF builds of Bosun 4B 4B for CPU / Apple Silicon / edge inference with llama.cpp https://github.com/ggml org/llama.cpp . The full model and the LoRA source live at Hanno Labs/bosun 4b https://huggingface.co/Hanno Labs/bosun 4b . ⚠️ Do NOT u…

Models
4
Downloads
314
Hanno-Labs/bosun-4b-GGUF
158 downloads ·
Hanno-Labs/bosun-xs-GGUF
156 downloads ·

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models