GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

peasantsmith/Laguna-S-2.1-PS-IQ2_XXS-GGUF overview

Laguna S 2.1 — PS IQ2 XXS Compact GGUF quantization of Laguna S 2.1 https://huggingface.co/poolside/Laguna S 2.1 , released by PeasantSmith. Inspired by Antire…

ggufquantizationmoetext-generationbase_model:poolside/Laguna-S-2.1base_model:quantized:poolside/Laguna-S-2.1endpoints_compatibleregion:usimatrixconversational

Runs locally from ~31.34 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).

Downloads
41
Likes
1
Pipeline
text-generation

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Laguna-S-2.1-PS-IQ2_XXS.ggufGGUFIQ2_XXS31.34 GBDownload

Model Details

Model IDpeasantsmith/Laguna-S-2.1-PS-IQ2_XXS-GGUF
Authorpeasantsmith
Pipelinetext-generation
License
Base modelpoolside/Laguna-S-2.1
Last modified2026-08-24T20:37:15.000Z

Model README

---

base_model: poolside/Laguna-S-2.1

base_model_relation: quantized

library_name: gguf

pipeline_tag: text-generation

tags:

  • quantization
  • gguf
  • moe

---

Laguna-S-2.1 — PS-IQ2_XXS

Compact GGUF quantization of Laguna-S-2.1, released by PeasantSmith. Inspired by Antirez's mixed-precision GGUF work.

Base model

MoE, 118B total / 8B active params: 256 routed experts + 1 shared, top-10 routing, 48 layers (12 global attention + 36 sliding-window, window 512), GQA. Context up to 1,048,576 tokens via YaRN scaling on the global layers. Built for agentic coding and long-horizon tasks.

Quality

| Model | PPL |

|---|---:|

| Laguna-S-2.1 F16 reference | 9.50 |

| Laguna-S-2.1 PS-IQ2_XXS | 11.5095 ± 0.26229 |

  • Needle retrieval: PASS
  • LRU-cache implementation: PASS
  • File size: 33.65 GB, ~2.28 bits/param

PPL was measured with llama-perplexity on the evaluation corpus. Results are corpus-dependent.

Recommended settings

temperature: 1.0
top_k: 20
top_p: 1.0

Compatible with GGUF runtimes including llama.cpp and Ollama.

License

OpenMDW-1.1, inherited from the base model.

Notes

Independently produced, experimental release with limited compute for testing. Feedback on quality, stability, and cross-runtime compatibility is welcome. See the upstream model page for full docs and license terms; verify behavior for your workload before relying on this in production.

Run peasantsmith/Laguna-S-2.1-PS-IQ2_XXS-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models