GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

unsloth/Laguna-S-2.1-GGUF overview

You can now run Laguna S 2.1 in Unsloth Studio or llama.cpp To run or train any LLM with a open source UI, install Unsloth Studio https://github.com/unslothai/…

transformersgguflaguna-s-2.1unslothvllmtext-generationbase_model:poolside/Laguna-S-2.1base_model:quantized:poolside/Laguna-S-2.1license:openmdw-1.1region:usimatrixconversational

Runs locally from ~3.5 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
28,542
Likes
152
Pipeline
text-generation
Author

Repository Files & Downloads

60 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
BF16/Laguna-S-2.1-BF16-00001-of-00005.ggufGGUFBF1646.55 GBDownload
BF16/Laguna-S-2.1-BF16-00002-of-00005.ggufGGUFBF1646.50 GBDownload
BF16/Laguna-S-2.1-BF16-00003-of-00005.ggufGGUFBF1646.50 GBDownload
BF16/Laguna-S-2.1-BF16-00004-of-00005.ggufGGUFBF1646.50 GBDownload
BF16/Laguna-S-2.1-BF16-00005-of-00005.ggufGGUFBF1633.00 GBDownload
Laguna-S-2.1-UD-IQ1_M.ggufGGUFIQ1_M33.19 GBDownload
Laguna-S-2.1-UD-IQ1_S.ggufGGUFIQ1_S31.45 GBDownload
Laguna-S-2.1-UD-IQ2_M.ggufGGUFIQ2_M34.71 GBDownload
Laguna-S-2.1-UD-IQ2_XXS.ggufGGUFIQ2_XXS34.64 GBDownload
Laguna-S-2.1-UD-IQ3_S.ggufGGUFIQ3_S45.10 GBDownload
Laguna-S-2.1-UD-IQ3_XXS.ggufGGUFIQ3_XXS41.24 GBDownload
Laguna-S-2.1-UD-Q2_K_XL.ggufGGUFQ2_K_XL36.96 GBDownload
MXFP4_MOE/Laguna-S-2.1-MXFP4_MOE-00001-of-00003.ggufGGUFGGUF3.5 MBDownload
MXFP4_MOE/Laguna-S-2.1-MXFP4_MOE-00002-of-00003.ggufGGUFGGUF46.46 GBDownload
MXFP4_MOE/Laguna-S-2.1-MXFP4_MOE-00003-of-00003.ggufGGUFGGUF19.74 GBDownload
Q8_0/Laguna-S-2.1-Q8_0-00001-of-00004.ggufGGUFQ8_03.5 MBDownload
Q8_0/Laguna-S-2.1-Q8_0-00002-of-00004.ggufGGUFQ8_045.93 GBDownload
Q8_0/Laguna-S-2.1-Q8_0-00003-of-00004.ggufGGUFQ8_045.95 GBDownload
Q8_0/Laguna-S-2.1-Q8_0-00004-of-00004.ggufGGUFQ8_024.55 GBDownload
UD-IQ4_NL/Laguna-S-2.1-UD-IQ4_NL-00001-of-00003.ggufGGUFIQ4_NL3.5 MBDownload
UD-IQ4_NL/Laguna-S-2.1-UD-IQ4_NL-00002-of-00003.ggufGGUFIQ4_NL46.22 GBDownload
UD-IQ4_NL/Laguna-S-2.1-UD-IQ4_NL-00003-of-00003.ggufGGUFIQ4_NL8.49 GBDownload
UD-IQ4_XS/Laguna-S-2.1-UD-IQ4_XS-00001-of-00003.ggufGGUFIQ4_XS3.5 MBDownload
UD-IQ4_XS/Laguna-S-2.1-UD-IQ4_XS-00002-of-00003.ggufGGUFIQ4_XS46.40 GBDownload
UD-IQ4_XS/Laguna-S-2.1-UD-IQ4_XS-00003-of-00003.ggufGGUFIQ4_XS7.21 GBDownload
UD-Q3_K_M/Laguna-S-2.1-UD-Q3_K_M-00001-of-00003.ggufGGUFQ3_K_M3.5 MBDownload
UD-Q3_K_M/Laguna-S-2.1-UD-Q3_K_M-00002-of-00003.ggufGGUFQ3_K_M46.54 GBDownload
UD-Q3_K_M/Laguna-S-2.1-UD-Q3_K_M-00003-of-00003.ggufGGUFQ3_K_M3.77 GBDownload
UD-Q3_K_XL/Laguna-S-2.1-UD-Q3_K_XL-00001-of-00003.ggufGGUFQ3_K_XL3.5 MBDownload
UD-Q3_K_XL/Laguna-S-2.1-UD-Q3_K_XL-00002-of-00003.ggufGGUFQ3_K_XL46.29 GBDownload
UD-Q3_K_XL/Laguna-S-2.1-UD-Q3_K_XL-00003-of-00003.ggufGGUFQ3_K_XL4.09 GBDownload
UD-Q4_K_M/Laguna-S-2.1-UD-Q4_K_M-00001-of-00003.ggufGGUFQ4_K_M3.5 MBDownload
UD-Q4_K_M/Laguna-S-2.1-UD-Q4_K_M-00002-of-00003.ggufGGUFQ4_K_M46.50 GBDownload
UD-Q4_K_M/Laguna-S-2.1-UD-Q4_K_M-00003-of-00003.ggufGGUFQ4_K_M21.59 GBDownload
UD-Q4_K_S/Laguna-S-2.1-UD-Q4_K_S-00001-of-00003.ggufGGUFQ4_K_S3.5 MBDownload
UD-Q4_K_S/Laguna-S-2.1-UD-Q4_K_S-00002-of-00003.ggufGGUFQ4_K_S46.18 GBDownload
UD-Q4_K_S/Laguna-S-2.1-UD-Q4_K_S-00003-of-00003.ggufGGUFQ4_K_S17.69 GBDownload
UD-Q4_K_XL/Laguna-S-2.1-UD-Q4_K_XL-00001-of-00003.ggufGGUFQ4_K_XL3.5 MBDownload
UD-Q4_K_XL/Laguna-S-2.1-UD-Q4_K_XL-00002-of-00003.ggufGGUFQ4_K_XL46.54 GBDownload
UD-Q4_K_XL/Laguna-S-2.1-UD-Q4_K_XL-00003-of-00003.ggufGGUFQ4_K_XL21.81 GBDownload
UD-Q5_K_M/Laguna-S-2.1-UD-Q5_K_M-00001-of-00003.ggufGGUFQ5_K_M3.5 MBDownload
UD-Q5_K_M/Laguna-S-2.1-UD-Q5_K_M-00002-of-00003.ggufGGUFQ5_K_M46.09 GBDownload
UD-Q5_K_M/Laguna-S-2.1-UD-Q5_K_M-00003-of-00003.ggufGGUFQ5_K_M35.74 GBDownload
UD-Q5_K_S/Laguna-S-2.1-UD-Q5_K_S-00001-of-00003.ggufGGUFQ5_K_S3.5 MBDownload
UD-Q5_K_S/Laguna-S-2.1-UD-Q5_K_S-00002-of-00003.ggufGGUFQ5_K_S46.10 GBDownload
UD-Q5_K_S/Laguna-S-2.1-UD-Q5_K_S-00003-of-00003.ggufGGUFQ5_K_S30.87 GBDownload
UD-Q5_K_XL/Laguna-S-2.1-UD-Q5_K_XL-00001-of-00003.ggufGGUFQ5_K_XL3.5 MBDownload
UD-Q5_K_XL/Laguna-S-2.1-UD-Q5_K_XL-00002-of-00003.ggufGGUFQ5_K_XL46.09 GBDownload
UD-Q5_K_XL/Laguna-S-2.1-UD-Q5_K_XL-00003-of-00003.ggufGGUFQ5_K_XL35.93 GBDownload
UD-Q6_K/Laguna-S-2.1-UD-Q6_K-00001-of-00003.ggufGGUFQ6_K3.5 MBDownload
UD-Q6_K/Laguna-S-2.1-UD-Q6_K-00002-of-00003.ggufGGUFQ6_K46.13 GBDownload
UD-Q6_K/Laguna-S-2.1-UD-Q6_K-00003-of-00003.ggufGGUFQ6_K45.06 GBDownload
UD-Q6_K_XL/Laguna-S-2.1-UD-Q6_K_XL-00001-of-00004.ggufGGUFQ6_K_XL3.5 MBDownload
UD-Q6_K_XL/Laguna-S-2.1-UD-Q6_K_XL-00002-of-00004.ggufGGUFQ6_K_XL46.30 GBDownload
UD-Q6_K_XL/Laguna-S-2.1-UD-Q6_K_XL-00003-of-00004.ggufGGUFQ6_K_XL46.13 GBDownload
UD-Q6_K_XL/Laguna-S-2.1-UD-Q6_K_XL-00004-of-00004.ggufGGUFQ6_K_XL7.29 GBDownload
UD-Q8_K_XL/Laguna-S-2.1-UD-Q8_K_XL-00001-of-00004.ggufGGUFQ8_K_XL3.5 MBDownload
UD-Q8_K_XL/Laguna-S-2.1-UD-Q8_K_XL-00002-of-00004.ggufGGUFQ8_K_XL45.93 GBDownload
UD-Q8_K_XL/Laguna-S-2.1-UD-Q8_K_XL-00003-of-00004.ggufGGUFQ8_K_XL45.95 GBDownload
UD-Q8_K_XL/Laguna-S-2.1-UD-Q8_K_XL-00004-of-00004.ggufGGUFQ8_K_XL27.43 GBDownload

Model Details

Model IDunsloth/Laguna-S-2.1-GGUF
Authorunsloth
Pipelinetext-generation
Licenseopenmdw-1.1
Base modelpoolside/Laguna-S-2.1
Last modified2026-07-23T09:22:09.000Z

Model README

---

base_model:

  • poolside/Laguna-S-2.1

library_name: transformers

inference: false

extra_gated_description: >-

To learn more about how we process your personal data, please read our <a

href="https://poolside.ai/legal/privacy">Privacy Policy</a>.

tags:

  • laguna-s-2.1
  • unsloth
  • vllm

license: openmdw-1.1

pipeline_tag: text-generation

---

You can now run Laguna-S-2.1 in Unsloth Studio or llama.cpp

To run or train any LLM with a open-source UI, install Unsloth Studio via:

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex

Running Unsloth's UD-Q4_K_XL with llama.cpp

The GGUFs in this repo are Unsloth Dynamic 2.0

quants (imatrix calibrated). Laguna support is available starting from llama.cpp release b10087. Use this release or a newer one.

Download the UD-Q4_K_XL shards (~40GB, split into 3 files):

huggingface-cli download unsloth/Laguna-S-2.1-GGUF \
  --include "UD-Q4_K_XL/*" \
  --local-dir Laguna-S-2.1-GGUF

Serve it with llama-server (pass the first shard; the remaining shards load

automatically):

./llama.cpp/build/bin/llama-server \
    --model Laguna-S-2.1-GGUF/UD-Q4_K_XL/Laguna-S-2.1-UD-Q4_K_XL-00001-of-00003.gguf \
    --fit on --ctx-size 16384 --port 8000

Or run a one-off generation with llama-cli:

./llama.cpp/build/bin/llama-cli \
    --model Laguna-S-2.1-GGUF/UD-Q4_K_XL/Laguna-S-2.1-UD-Q4_K_XL-00001-of-00003.gguf \
    --fit on -p "Write a Flappy Bird game in Python."

<p align="center">

<img alt="poolside-banner" src="https://poolside.ai/assets/laguna/laguna-s-2-1-banner.svg" width="800px">

</p>

<p align="center">

<a href="https://openrouter.ai/poolside/laguna-s-2.1"><strong>Use on OpenRouter</strong></a> ·

<a href="https://vercel.com/ai-gateway/models/laguna-s-2.1"><strong>Use on Vercel AI Gateway</strong></a> ·

<a href="https://poolside.ai/blog/introducing-laguna-s-2-1"><strong>Release blog post</strong></a>

</p>

<br>

Laguna S 2.1

Laguna S 2.1 is a 118B total parameter Mixture-of-Experts model with 8B activated

parameters per token, designed for agentic coding and long-horizon work. It sits

between Laguna XS 2.1 (33B-A3B) and

Laguna M.1 (225B-A23B) in the Laguna series and shares the family recipe: a

token-choice router with softplus gating over 256 routed experts plus one shared

expert, grouped-query attention, and interleaved full/sliding-window attention.

Highlights

  • Mixed SWA and global attention layout: 48 layers in a 1:3 global-to-SWA ratio

(12 global attention layers, 36 sliding-window layers, window 512), with softplus

attention gating and per-layer-type rotary scales

  • 1M context: 1,048,576-token context window
  • Native reasoning support: interleaved thinking between tool calls, with

per-request control via enable_thinking

  • Speculative decoding: a trained

DFlash draft model is available

for lower-latency serving

  • Quantized variants:

FP8,

NVFP4,

INT4 and

GGUF

  • OpenMDW-1.1 license: Use and modify the model and associated materials freely

for commercial and non-commercial purposes

(learn more about OpenMDW)

Model overview

  • Number of parameters: 118B total, ~8B activated per token
  • Layers: 48 (12 global attention, 36 sliding-window attention)
  • Experts: 256 routed (top-10) plus 1 shared expert
  • Attention: grouped-query, 8 KV heads, head dim 128; per-head softplus output gating
  • Sliding window: 512 tokens
  • Context window: 1,048,576 tokens
  • Vocabulary: 100,352 tokens (Laguna family tokenizer)
  • Modality: text-to-text
  • Reasoning: interleaved thinking with preserved thinking

Benchmark results

<p align="center">

<img alt="benchmarks" src="https://poolside.ai/assets/laguna/laguna-s-2-1-chart.svg" width="800px">

</p>

| Model | Size | Terminal-Bench 2.1 | SWE-bench Multilingual | SWE-Bench Pro (Public Dataset) | DeepSWE | SWE Atlas (Codebase QnA) | Toolathlon Verified |

|---|---|---|---|---|---|---|---|

| Laguna S 2.1 | 118B-A8B | 70.2% | 78.5% | 59.4% | 40.4% | 46.2% | 49.7% |

| Tencent Hy3 | 295B-A21B | 71.7% | 75.8% | 57.9% | - | - | - |

| Inkling | 975B-A41B | 63.8% | - | 54.3% | - | - | 45.5%* |

| Nemotron 3 Ultra | 550B-A55B | 56.4% | 67.7% | - | - | - | 34.3%* |

| DeepSeek-V4-Pro Max | 1.6T-A49B | 64.0% | 76.2% | 55.4% | 9.0% | 27.2% | 55.9% |

| Kimi K3 | 2800B-A50B | 88.3% | - | - | 69% | - | - |

| Qwen 3.7 Max | - | 74.5%* | 78.3% | 60.6% | - | - | - |

| Muse Spark 1.1 | - | 80% | - | 61.5% | 53.3% | 42.2%* | 75.6% |

| Claude Fable 5 | - | 88% | - | 80.3% | 70% | - | - |

Benchmarks as of 21 July 2026. Laguna S 2.1 in bold; a dash (-) marks a benchmark a model was not evaluated on. Scores marked * are as reported by third parties: Terminal-Bench 2.1 and DeepSWE via Artificial Analysis, SWE Atlas via Scale AI's official leaderboard, and Toolathlon Verified via its official leaderboard. Full evaluation trajectories: trajectories.poolside.ai.

Usage

Laguna S 2.1 uses the same laguna architecture as Laguna XS 2.1, so the same

engine integrations apply (vLLM, SGLang, Transformers, TRT-LLM, llama.cpp). At 118B

parameters the BF16 checkpoint needs multiple GPUs (roughly 236GB of weights);

quantized variants reduce this substantially.

vLLM

vllm serve \
    --model poolside/Laguna-S-2.1 \
    --tensor-parallel-size 4 \
    --tool-call-parser poolside_v1 \
    --reasoning-parser poolside_v1 \
    --enable-auto-tool-choice \
    --served-model-name laguna \
    --default-chat-template-kwargs '{"enable_thinking": true}'

> [!NOTE]

> Optional: speculative decoding with DFlash. Pair with the

> Laguna S 2.1 DFlash draft model

> by adding

> --speculative-config '{"model":"poolside/Laguna-S-2.1-DFlash","num_speculative_tokens":7,"method":"dflash"}'.

SGLang

python -m sglang.launch_server \
  --model-path poolside/Laguna-S-2.1 \
  --tp-size 4 \
  --reasoning-parser poolside_v1 \
  --tool-call-parser poolside_v1 \
  --trust-remote-code

TRT-LLM

trtllm-serve poolside/Laguna-S-2.1 --trust-remote-code \
    --tool_parser poolside_v1 --reasoning_parser laguna

Note the flag names differ from vLLM's (--tool_parser, and the reasoning parser

is laguna, not poolside_v1).

llama.cpp

GGUF conversions are available at

poolside/Laguna-S-2.1-GGUF.

Serve with poolside's llama.cpp fork, branch

laguna, which carries

full Laguna support including DFlash speculative decoding. (Base Laguna support

is also in upstream review:

ggml-org/llama.cpp#25165.)

git clone --branch laguna https://github.com/poolsideai/llama.cpp
cd llama.cpp && cmake -B build && cmake --build build -j

./build/bin/llama-server -m laguna-s-2.1-Q4_K_M.gguf --jinja --port 8000

# with DFlash speculative decoding:
./build/bin/llama-server -m laguna-s-2.1-Q4_K_M.gguf \
  -md laguna-s-2.1-DFlash-BF16.gguf \
  --spec-type draft-dflash --spec-draft-n-max 15 -fa on --jinja --port 8000

Controlling reasoning

Laguna S 2.1 has native reasoning support and works best with preserved thinking:

keep reasoning_content from prior assistant messages in the message history.

The model will generally reason before calling tools and between tool calls, and

may stop reasoning in follow-up steps if prior thinking blocks are dropped.

Thinking is controlled per request via the chat template:

extra_body={"chat_template_kwargs": {"enable_thinking": False}}

or at the server level with

--default-chat-template-kwargs '{"enable_thinking": true}'. For agentic coding

use cases we recommend enabling thinking and preserving reasoning in the message

history.

License

This model is licensed under the OpenMDW-1.1 License.

Intended and Responsible Use

Laguna S 2.1 is designed for software engineering and agentic coding use cases, and you are responsible for confirming that it is appropriate for your intended application. Laguna S 2.1 is subject to the OpenMDW-1.1 License, and should be used consistently with Poolside's Acceptable Use Policy. We advise against circumventing Laguna S 2.1 safety guardrails without implementing substantially equivalent mitigations appropriate for your use case.

Please report security vulnerabilities or safety concerns to security@poolside.ai.

Run unsloth/Laguna-S-2.1-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models