GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

1bit-MONSTER/gpt-oss-120b-GGUF overview

gpt oss 120b — GGUF UD Q4 K XL Unsloth's Dynamic 2.0 UD Q4 K XL GGUF for OpenAI's gpt oss 120b a ~117B MoE , re hosted for the 1bit engine https://github.com/1…

ggufmoebase_model:openai/gpt-oss-120bbase_model:quantized:openai/gpt-oss-120blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~12.25 GB disk (16 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
—

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
UD-Q4_K_XL/gpt-oss-120b-UD-Q4_K_XL-00001-of-00002.ggufGGUFQ4_K_XL46.44 GBDownload
UD-Q4_K_XL/gpt-oss-120b-UD-Q4_K_XL-00002-of-00002.ggufGGUFQ4_K_XL12.25 GBDownload

Model Details

Model ID1bit-MONSTER/gpt-oss-120b-GGUF
Author1bit-MONSTER
Pipeline—
Licenseapache-2.0
Base modelopenai/gpt-oss-120b,unsloth/gpt-oss-120b-GGUF
Last modified2026-09-26T16:40:05.000Z

Model README

---

license: apache-2.0

base_model:

  • openai/gpt-oss-120b
  • unsloth/gpt-oss-120b-GGUF

tags:

  • gguf
  • moe

---

gpt-oss-120b — GGUF (UD-Q4_K_XL)

Unsloth's Dynamic 2.0 UD-Q4_K_XL GGUF for OpenAI's gpt-oss-120b (a ~117B MoE), re-hosted

for the 1bit engine.

Contents

  • UD-Q4_K_XL/gpt-oss-120b-UD-Q4_K_XL-00001-of-00002.gguf
  • UD-Q4_K_XL/gpt-oss-120b-UD-Q4_K_XL-00002-of-00002.gguf

~63 GiB total. Needs a comparable amount of resident memory to run.

Running it

Point at the first shard — llama.cpp finds the rest automatically:

1bit serve -m UD-Q4_K_XL/gpt-oss-120b-UD-Q4_K_XL-00001-of-00002.gguf --device vulkan

Attribution

Run 1bit-MONSTER/gpt-oss-120b-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models