GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ggml-org/gpt-oss-20b-GGUF overview

gpt oss 20b Run with https://llama.app bash llama serve hf ggml org/gpt oss 20b GGUF Source models https://huggingface.co/openai/gpt oss 20b https://huggingfac…

ggufquantizedtext-generationbase_model:openai/gpt-oss-20bbase_model:quantized:openai/gpt-oss-20blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~878.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
48,439
Likes
166
Pipeline
text-generation
Author

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
eagle3-gpt-oss-20b-BF16.ggufGGUFBF161.60 GBDownload
eagle3-gpt-oss-20b-Q8_0.ggufGGUFQ8_0878.8 MBDownload
gpt-oss-20b-MXFP4.ggufGGUFGGUF11.28 GBDownload

Model Details

Model IDggml-org/gpt-oss-20b-GGUF
Authorggml-org
Pipelinetext-generation
Licenseapache-2.0
Base modelopenai/gpt-oss-20b
Last modified2026-07-28T07:55:12.000Z

Model README

---

license: apache-2.0

pipeline_tag: text-generation

tags:

  • gguf
  • quantized

base_model:

  • openai/gpt-oss-20b

---

gpt-oss-20b

Run with https://llama.app

llama serve -hf ggml-org/gpt-oss-20b-GGUF

Source models

  • https://huggingface.co/openai/gpt-oss-20b
  • https://huggingface.co/RedHatAI/gpt-oss-20b-speculator.eagle3

TODOs

  • add info

> [!IMPORTANT]

> This model is automatically converted using https://github.com/ggml-org/convert

Run ggml-org/gpt-oss-20b-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models