peasantsmith/Laguna-S-2.1-PS-IQ2_XXS-GGUF overview
Laguna S 2.1 — PS IQ2 XXS Compact GGUF quantization of Laguna S 2.1 https://huggingface.co/poolside/Laguna S 2.1 , released by PeasantSmith. Inspired by Antire…
Runs locally from ~31.34 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Laguna-S-2.1-PS-IQ2_XXS.gguf | GGUF | IQ2_XXS | 31.34 GB | Download |
Model Details
| Model ID | peasantsmith/Laguna-S-2.1-PS-IQ2_XXS-GGUF |
|---|---|
| Author | peasantsmith |
| Pipeline | text-generation |
| License | — |
| Base model | poolside/Laguna-S-2.1 |
| Last modified | 2026-08-24T20:37:15.000Z |
Model README
---
base_model: poolside/Laguna-S-2.1
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
tags:
- quantization
- gguf
- moe
---
Laguna-S-2.1 — PS-IQ2_XXS
Compact GGUF quantization of Laguna-S-2.1, released by PeasantSmith. Inspired by Antirez's mixed-precision GGUF work.
Base model
MoE, 118B total / 8B active params: 256 routed experts + 1 shared, top-10 routing, 48 layers (12 global attention + 36 sliding-window, window 512), GQA. Context up to 1,048,576 tokens via YaRN scaling on the global layers. Built for agentic coding and long-horizon tasks.
Quality
| Model | PPL |
|---|---:|
| Laguna-S-2.1 F16 reference | 9.50 |
| Laguna-S-2.1 PS-IQ2_XXS | 11.5095 ± 0.26229 |
- Needle retrieval: PASS
- LRU-cache implementation: PASS
- File size: 33.65 GB, ~2.28 bits/param
PPL was measured with llama-perplexity on the evaluation corpus. Results are corpus-dependent.
Recommended settings
temperature: 1.0
top_k: 20
top_p: 1.0
Compatible with GGUF runtimes including llama.cpp and Ollama.
License
OpenMDW-1.1, inherited from the base model.
Notes
Independently produced, experimental release with limited compute for testing. Feedback on quality, stability, and cross-runtime compatibility is welcome. See the upstream model page for full docs and license terms; verify behavior for your workload before relying on this in production.
Run peasantsmith/Laguna-S-2.1-PS-IQ2_XXS-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models