Model Intelligence Sheet
DevQuasar/thinkingmachines.Inkling-GGUF overview
<img src="https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dq logo black transparent.png" width="200"/ https://devquasar.com 'Make knowledge fr…
Runs locally from ~174.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
115 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00001-of-00017.gguf | GGUF | IQ2_XXS | 14.29 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00002-of-00017.gguf | GGUF | IQ2_XXS | 14.20 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00003-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00004-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00005-of-00017.gguf | GGUF | IQ2_XXS | 14.20 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00006-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00007-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00008-of-00017.gguf | GGUF | IQ2_XXS | 14.20 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00009-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00010-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00011-of-00017.gguf | GGUF | IQ2_XXS | 14.20 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00012-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00013-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00014-of-00017.gguf | GGUF | IQ2_XXS | 14.20 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00015-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00016-of-00017.gguf | GGUF | IQ2_XXS | 14.19 GB | Download |
| IQ2_XXS/thinkingmachines.Inkling.IQ2_XXS-00017-of-00017.gguf | GGUF | IQ2_XXS | 2.34 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00001-of-00024.gguf | GGUF | Q2_K | 13.69 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00002-of-00024.gguf | GGUF | Q2_K | 12.98 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00003-of-00024.gguf | GGUF | Q2_K | 14.89 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00004-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00005-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00006-of-00024.gguf | GGUF | Q2_K | 12.98 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00007-of-00024.gguf | GGUF | Q2_K | 14.89 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00008-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00009-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00010-of-00024.gguf | GGUF | Q2_K | 12.98 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00011-of-00024.gguf | GGUF | Q2_K | 14.89 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00012-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00013-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00014-of-00024.gguf | GGUF | Q2_K | 12.99 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00015-of-00024.gguf | GGUF | Q2_K | 14.89 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00016-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00017-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00018-of-00024.gguf | GGUF | Q2_K | 12.99 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00019-of-00024.gguf | GGUF | Q2_K | 14.89 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00020-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00021-of-00024.gguf | GGUF | Q2_K | 13.44 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00022-of-00024.gguf | GGUF | Q2_K | 12.99 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00023-of-00024.gguf | GGUF | Q2_K | 14.89 GB | Download |
| Q2_K/thinkingmachines.Inkling.Q2_K-00024-of-00024.gguf | GGUF | Q2_K | 4.97 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00001-of-00033.gguf | GGUF | Q3_K_M | 14.23 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00002-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00003-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00004-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00005-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00006-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00007-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00008-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00009-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00010-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00011-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00012-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00013-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00014-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00015-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00016-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00017-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00018-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00019-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00020-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00021-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00022-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00023-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00024-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00025-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00026-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00027-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00028-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00029-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00030-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00031-of-00033.gguf | GGUF | Q3_K_M | 13.03 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00032-of-00033.gguf | GGUF | Q3_K_M | 13.02 GB | Download |
| Q3_K_M/thinkingmachines.Inkling.Q3_K_M-00033-of-00033.gguf | GGUF | Q3_K_M | 1.95 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00001-of-00040.gguf | GGUF | Q4_K_M | 11.27 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00002-of-00040.gguf | GGUF | Q4_K_M | 12.62 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00003-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00004-of-00040.gguf | GGUF | Q4_K_M | 12.62 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00005-of-00040.gguf | GGUF | Q4_K_M | 12.91 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00006-of-00040.gguf | GGUF | Q4_K_M | 14.01 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00007-of-00040.gguf | GGUF | Q4_K_M | 12.89 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00008-of-00040.gguf | GGUF | Q4_K_M | 14.08 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00009-of-00040.gguf | GGUF | Q4_K_M | 12.84 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00010-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00011-of-00040.gguf | GGUF | Q4_K_M | 12.91 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00012-of-00040.gguf | GGUF | Q4_K_M | 14.01 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00013-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00014-of-00040.gguf | GGUF | Q4_K_M | 12.90 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00015-of-00040.gguf | GGUF | Q4_K_M | 14.01 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00016-of-00040.gguf | GGUF | Q4_K_M | 12.90 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00017-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00018-of-00040.gguf | GGUF | Q4_K_M | 12.84 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00019-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00020-of-00040.gguf | GGUF | Q4_K_M | 12.91 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00021-of-00040.gguf | GGUF | Q4_K_M | 14.00 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00022-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00023-of-00040.gguf | GGUF | Q4_K_M | 12.91 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00024-of-00040.gguf | GGUF | Q4_K_M | 14.01 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00025-of-00040.gguf | GGUF | Q4_K_M | 12.89 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00026-of-00040.gguf | GGUF | Q4_K_M | 14.08 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00027-of-00040.gguf | GGUF | Q4_K_M | 12.84 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00028-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00029-of-00040.gguf | GGUF | Q4_K_M | 12.91 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00030-of-00040.gguf | GGUF | Q4_K_M | 14.01 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00031-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00032-of-00040.gguf | GGUF | Q4_K_M | 12.90 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00033-of-00040.gguf | GGUF | Q4_K_M | 14.01 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00034-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00035-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00036-of-00040.gguf | GGUF | Q4_K_M | 12.62 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00037-of-00040.gguf | GGUF | Q4_K_M | 14.08 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00038-of-00040.gguf | GGUF | Q4_K_M | 12.62 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00039-of-00040.gguf | GGUF | Q4_K_M | 14.07 GB | Download |
| Q4_K_M/thinkingmachines.Inkling.Q4_K_M-00040-of-00040.gguf | GGUF | Q4_K_M | 8.83 GB | Download |
| mmproj-thinkingmachines.Inkling.f16.gguf | GGUF | GGUF | 174.8 MB | Download |
Model Details
| Model ID | DevQuasar/thinkingmachines.Inkling-GGUF |
|---|---|
| Author | DevQuasar |
| Pipeline | image-text-to-text |
| License | — |
| Base model | thinkingmachines/Inkling |
| Last modified | 2026-07-17T18:50:36.000Z |
Model README
---
base_model:
- thinkingmachines/Inkling
pipeline_tag: image-text-to-text
---
'Make knowledge free for everyone'
Experimental
Inkling support: PR #25731
Quantized version of: thinkingmachines/Inkling
<a href='https://ko-fi.com/L4L416YX7C' target='_blank'><img height='36' style='border:0px;height:36px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com' /></a>
Run DevQuasar/thinkingmachines.Inkling-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models