Model Intelligence Sheet
baselquant/Inkling-GGUF overview
baselquant/Inkling-GGUF GGUF downloads for local AI inference with guIDE.
Runs locally from ~977.9 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
48 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| IQ1_M-final/Inkling-Atomic-IQ1_M-00001-of-00006.gguf | GGUF | IQ1_M | 41.22 GB | Download |
| IQ1_M-final/Inkling-Atomic-IQ1_M-00002-of-00006.gguf | GGUF | IQ1_M | 41.60 GB | Download |
| IQ1_M-final/Inkling-Atomic-IQ1_M-00003-of-00006.gguf | GGUF | IQ1_M | 41.60 GB | Download |
| IQ1_M-final/Inkling-Atomic-IQ1_M-00004-of-00006.gguf | GGUF | IQ1_M | 41.60 GB | Download |
| IQ1_M-final/Inkling-Atomic-IQ1_M-00005-of-00006.gguf | GGUF | IQ1_M | 41.59 GB | Download |
| IQ1_M-final/Inkling-Atomic-IQ1_M-00006-of-00006.gguf | GGUF | IQ1_M | 3.07 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00001-of-00013.gguf | GGUF | GGUF | 40.84 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00002-of-00013.gguf | GGUF | GGUF | 39.52 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00003-of-00013.gguf | GGUF | GGUF | 39.53 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00004-of-00013.gguf | GGUF | GGUF | 39.65 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00005-of-00013.gguf | GGUF | GGUF | 39.53 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00006-of-00013.gguf | GGUF | GGUF | 39.53 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00007-of-00013.gguf | GGUF | GGUF | 39.65 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00008-of-00013.gguf | GGUF | GGUF | 39.52 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00009-of-00013.gguf | GGUF | GGUF | 39.53 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00010-of-00013.gguf | GGUF | GGUF | 39.65 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00011-of-00013.gguf | GGUF | GGUF | 39.52 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00012-of-00013.gguf | GGUF | GGUF | 39.53 GB | Download |
| MXFP4/Inkling-Atomic-MXFP4-00013-of-00013.gguf | GGUF | GGUF | 2.43 GB | Download |
| Q8_0/Inkling-Q8_0-00001-of-00025.gguf | GGUF | Q8_0 | 37.75 GB | Download |
| Q8_0/Inkling-Q8_0-00002-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00003-of-00025.gguf | GGUF | Q8_0 | 38.83 GB | Download |
| Q8_0/Inkling-Q8_0-00004-of-00025.gguf | GGUF | Q8_0 | 38.94 GB | Download |
| Q8_0/Inkling-Q8_0-00005-of-00025.gguf | GGUF | Q8_0 | 38.96 GB | Download |
| Q8_0/Inkling-Q8_0-00006-of-00025.gguf | GGUF | Q8_0 | 38.82 GB | Download |
| Q8_0/Inkling-Q8_0-00007-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00008-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00009-of-00025.gguf | GGUF | Q8_0 | 38.83 GB | Download |
| Q8_0/Inkling-Q8_0-00010-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00011-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00012-of-00025.gguf | GGUF | Q8_0 | 38.83 GB | Download |
| Q8_0/Inkling-Q8_0-00013-of-00025.gguf | GGUF | Q8_0 | 38.94 GB | Download |
| Q8_0/Inkling-Q8_0-00014-of-00025.gguf | GGUF | Q8_0 | 38.96 GB | Download |
| Q8_0/Inkling-Q8_0-00015-of-00025.gguf | GGUF | Q8_0 | 38.82 GB | Download |
| Q8_0/Inkling-Q8_0-00016-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00017-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00018-of-00025.gguf | GGUF | Q8_0 | 38.83 GB | Download |
| Q8_0/Inkling-Q8_0-00019-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00020-of-00025.gguf | GGUF | Q8_0 | 38.95 GB | Download |
| Q8_0/Inkling-Q8_0-00021-of-00025.gguf | GGUF | Q8_0 | 38.83 GB | Download |
| Q8_0/Inkling-Q8_0-00022-of-00025.gguf | GGUF | Q8_0 | 38.94 GB | Download |
| Q8_0/Inkling-Q8_0-00023-of-00025.gguf | GGUF | Q8_0 | 38.96 GB | Download |
| Q8_0/Inkling-Q8_0-00024-of-00025.gguf | GGUF | Q8_0 | 38.82 GB | Download |
| Q8_0/Inkling-Q8_0-00025-of-00025.gguf | GGUF | Q8_0 | 4.82 GB | Download |
| imatrix/imatrix-code-at_128.gguf | GGUF | GGUF | 977.9 MB | Download |
| imatrix/imatrix-code-at_2048.gguf | GGUF | GGUF | 977.9 MB | Download |
| imatrix/imatrix-code-at_512.gguf | GGUF | GGUF | 977.9 MB | Download |
| imatrix/imatrix-code-final.gguf | GGUF | GGUF | 977.9 MB | Download |
Model Details
| Model ID | baselquant/Inkling-GGUF |
|---|---|
| Author | baselquant |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | thinkingmachines/Inkling |
| Last modified | 2026-07-28T09:53:18.000Z |
Run baselquant/Inkling-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models