GraySoft
Download guIDE →
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

DevQuasar/thinkingmachines.Inkling-Small-GGUF overview

<img src="https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dq logo black transparent.png" width="200"/ https://devquasar.com 'Make knowledge fr…

ggufimage-text-to-textbase_model:thinkingmachines/Inkling-Smallbase_model:quantized:thinkingmachines/Inkling-Smallendpoints_compatibleregion:usconversational

Runs locally from ~132.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
image-text-to-text
Author
DevQuasar

Repository Files & Downloads

72 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Q2_K/thinkingmachines.Inkling-Small.f16.gguf.Q2_K.gguf-00001-of-00008.ggufGGUFQ2_K12.99 GBDownload
Q2_K/thinkingmachines.Inkling-Small.f16.gguf.Q2_K.gguf-00002-of-00008.ggufGGUFQ2_K12.39 GBDownload
Q2_K/thinkingmachines.Inkling-Small.f16.gguf.Q2_K.gguf-00003-of-00008.ggufGGUFQ2_K12.58 GBDownload
Q2_K/thinkingmachines.Inkling-Small.f16.gguf.Q2_K.gguf-00004-of-00008.ggufGGUFQ2_K12.59 GBDownload
Q2_K/thinkingmachines.Inkling-Small.f16.gguf.Q2_K.gguf-00005-of-00008.ggufGGUFQ2_K12.39 GBDownload
Q2_K/thinkingmachines.Inkling-Small.f16.gguf.Q2_K.gguf-00006-of-00008.ggufGGUFQ2_K12.58 GBDownload
Q2_K/thinkingmachines.Inkling-Small.f16.gguf.Q2_K.gguf-00007-of-00008.ggufGGUFQ2_K12.59 GBDownload
Q2_K/thinkingmachines.Inkling-Small.f16.gguf.Q2_K.gguf-00008-of-00008.ggufGGUFQ2_K1.33 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00001-of-00010.ggufGGUFQ3_K_M12.79 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00002-of-00010.ggufGGUFQ3_K_M12.70 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00003-of-00010.ggufGGUFQ3_K_M12.43 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00004-of-00010.ggufGGUFQ3_K_M12.45 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00005-of-00010.ggufGGUFQ3_K_M12.70 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00006-of-00010.ggufGGUFQ3_K_M12.43 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00007-of-00010.ggufGGUFQ3_K_M12.45 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00008-of-00010.ggufGGUFQ3_K_M12.70 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00009-of-00010.ggufGGUFQ3_K_M12.43 GBDownload
Q3_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q3_K_M.gguf-00010-of-00010.ggufGGUFQ3_K_M3.76 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00001-of-00014.ggufGGUFQ5_K_M12.10 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00002-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00003-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00004-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00005-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00006-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00007-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00008-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00009-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00010-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00011-of-00014.ggufGGUFQ5_K_M12.84 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00012-of-00014.ggufGGUFQ5_K_M11.45 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00013-of-00014.ggufGGUFQ5_K_M11.96 GBDownload
Q5_K_M/thinkingmachines.Inkling-Small.f16.gguf.Q5_K_M.gguf-00014-of-00014.ggufGGUFQ5_K_M10.30 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00001-of-00018.ggufGGUFQ6_K11.68 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00002-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00003-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00004-of-00018.ggufGGUFQ6_K11.68 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00005-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00006-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00007-of-00018.ggufGGUFQ6_K11.68 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00008-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00009-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00010-of-00018.ggufGGUFQ6_K11.68 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00011-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00012-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00013-of-00018.ggufGGUFQ6_K11.68 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00014-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00015-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00016-of-00018.ggufGGUFQ6_K11.68 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00017-of-00018.ggufGGUFQ6_K11.65 GBDownload
Q6_K/thinkingmachines.Inkling-Small.f16.gguf.Q6_K.gguf-00018-of-00018.ggufGGUFQ6_K3.31 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00001-of-00021.ggufGGUFQ8_012.93 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00002-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00003-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00004-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00005-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00006-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00007-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00008-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00009-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00010-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00011-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00012-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00013-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00014-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00015-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00016-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00017-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00018-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00019-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00020-of-00021.ggufGGUFQ8_012.95 GBDownload
Q8_0/thinkingmachines.Inkling-Small.f16.gguf.Q8_0.gguf-00021-of-00021.ggufGGUFQ8_02.14 GBDownload
mmproj-thinkingmachines.Inkling-Small.f16.ggufGGUFGGUF132.3 MBDownload

Model Details

Model IDDevQuasar/thinkingmachines.Inkling-Small-GGUF
AuthorDevQuasar
Pipelineimage-text-to-text
License—
Base modelthinkingmachines/Inkling-Small
Last modified2026-07-31T06:57:16.000Z

Model README

---

base_model:

  • thinkingmachines/Inkling-Small

pipeline_tag: image-text-to-text

---

<img src="https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dq_logo_black-transparent.png" width="200"/>

'Make knowledge free for everyone'

Quantized version of: thinkingmachines/Inkling-Small

<a href='https://ko-fi.com/L4L416YX7C' target='_blank'><img height='36' style='border:0px;height:36px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com' /></a>

Run DevQuasar/thinkingmachines.Inkling-Small-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models