GraySoft
Projects Models About FAQ Contact Download guIDE →

ggml-org/granite-docling-258m-gguf F16 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

ggml-org/granite-docling-258m-gguf overview

Original model: https://huggingface.co/ibm-granite/granite-docling-258M Related PR: https://github.com/ggml-org/llama.cpp/pull/16206

ggufbase_model:ibm-granite/granite-docling-258Mbase_model:quantized:ibm-granite/granite-docling-258Mlicense:apache-2.0endpoints_compatibleregion:usconversational
ggml-org/granite-docling-258m-gguf visual
Downloads
1,139
Likes
10
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

4 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
granite-docling-258M-Q8_0.gguf GGUF 169.68 MB Download
granite-docling-258M-f16.gguf GGUF F16 316.28 MB Download
mmproj-granite-docling-258M-Q8_0.gguf GGUF 98.96 MB Download
mmproj-granite-docling-258M-f16.gguf GGUF F16 181.23 MB Download

Model Details Live

Model Slug
ggml-org/granite-docling-258m-gguf
Author
ggml-org
Pipeline Task
Library
Created
2025-10-05
Last Modified
2025-10-05
Gated
No
Private
No
HF SHA
684c1800c5fbd614e29b4d1a82177e6c122af1f3
License
apache-2.0
Language
Unknown
Base Model
ibm-granite/granite-docling-258M

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": [
      "ibm-granite/granite-docling-258M"
    ],
    "license": "apache-2.0",
    "frontmatter": {
      "base_model": [
        "ibm-granite/granite-docling-258M"
      ],
      "license": "apache-2.0"
    },
    "hero_image_url": "",
    "summary": "Original model: https://huggingface.co/ibm-granite/granite-docling-258M Related PR: https://github.com/ggml-org/llama.cpp/pull/16206",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model:\n- ibm-granite/granite-docling-258M\nlicense: apache-2.0\n---\n\n# granite-docling-258M-GGUF\n\nOriginal model: https://huggingface.co/ibm-granite/granite-docling-258M\n\nRelated PR: https://github.com/ggml-org/llama.cpp/pull/16206",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "base_model:ibm-granite/granite-docling-258M",
    "base_model:quantized:ibm-granite/granite-docling-258M",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 10,
  "downloads": 1139,
  "gated": false,
  "private": false,
  "last_modified": "2025-10-05T11:32:45.000Z",
  "created_at": "2025-10-05T11:22:38.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "68e254fe21d038721ed370da",
  "id": "ggml-org/granite-docling-258M-GGUF",
  "modelId": "ggml-org/granite-docling-258M-GGUF",
  "sha": "684c1800c5fbd614e29b4d1a82177e6c122af1f3",
  "createdAt": "2025-10-05T11:22:38.000Z",
  "lastModified": "2025-10-05T11:32:45.000Z",
  "author": "ggml-org",
  "downloads": 1139,
  "likes": 10,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 6
}