---

library_name: llama.cpp

license: apache-2.0

base_model: AI4SGI/ExoMind-9B

base_model_relation: quantized

pipeline_tag: image-text-to-text

tags:

• exomind
• gguf
• llama-cpp
• q8_0
• scientific-reasoning
• agentic
• tool-use
• multimodal
• qwen3.5

---

<div align="center">

<img src="./assets/ExoMind.png" alt="ExoMind" width="560">

ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System

ExoMind Team · Shanghai Artificial Intelligence Laboratory

<p>

<a href="https://ai4sgi.github.io/ExoMind/"><img src="https://img.shields.io/badge/Project_Page-Visit-174F87?style=for-the-badge&logo=googlechrome&logoColor=white" alt="Project Page"></a>

<a href="https://doi.org/10.20944/preprints202608.2038.v1"><img src="https://img.shields.io/badge/Paper-Preprint-B31B1B?style=for-the-badge&logo=adobeacrobatreader&logoColor=white" alt="ExoMind preprint"></a>

</p>

<p>

<a href="https://huggingface.co/AI4SGI/ExoMind-9B-Q8_0-GGUF"><img src="https://img.shields.io/badge/Hugging_Face-Model-FFD21E?style=for-the-badge&logo=huggingface&logoColor=000000" alt="Hugging Face"></a>

<a href="https://github.com/AI4SGI/ExoMind"><img src="https://img.shields.io/badge/GitHub-Code-181717?style=for-the-badge&logo=github&logoColor=white" alt="GitHub"></a>

<a href="https://modelscope.cn/models/AI4SGI/ExoMind-9B-Q8_0-GGUF"><img src="https://img.shields.io/badge/ModelScope-Model-624AFF?style=for-the-badge" alt="ModelScope"></a>

</p>

</div>

Overview

Q8_0 GGUF release of ExoMind-9B, balancing higher-fidelity local inference with compact-model accessibility.

This repository intentionally contains only the Q8_0 model and

the matching multimodal projector. Keeping each precision in its own repository

makes downloads, local disk requirements, and deployment commands explicit.

Files

| File | Role | Download size |

| --- | --- | ---: |

| qwen3_5_9b-Q8_0.gguf | Q8_0 model | 8.87 GiB |

| mmproj-qwen3_5_9b-F16.gguf | F16 multimodal projector | 875.63 MiB |

Quick Start with llama.cpp

Text-only serving:

llama-server \
  -m qwen3_5_9b-Q8_0.gguf \
  --ctx-size 32768 \
  --host 0.0.0.0 \
  --port 8080

For image input, load the projector shipped in this repository:

llama-server \
  -m qwen3_5_9b-Q8_0.gguf \
  --mmproj mmproj-qwen3_5_9b-F16.gguf \
  --ctx-size 32768 \
  --host 0.0.0.0 \
  --port 8080

Conversion Provenance

These GGUF files were supplied as existing release artifacts. Their exact filenames, byte sizes, and GGUF v3 headers were validated before publication, but the original HF-to-GGUF conversion and quantization commands were not retained with the files. The repository therefore does not claim bit-for-bit reproducibility of the original conversion pipeline.

Evaluation Boundary

The main ExoMind benchmark table reports the 35B-A3B system and must not be attributed to ExoMind-9B. This Q8_0 variant has no separate scores.

Complete settings and comparisons are available in the

evaluation explorer.

License and Attribution

The model files and upstream Qwen3.5 materials are distributed under the Apache

License 2.0 included with the model. Preprint text, scientific figures,

results, and ExoMind brand assets are governed by the

ExoMind Research Content and Brand Terms. See

NOTICE.md for third-party notices.

Citation

@article{Ye_2026,
  title     = {ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System},
  author    = {Ye, Peng and Liu, Zhuo and Ye, Jingqi and Yu, Fangchen and Tang, Shengji and Jiang, Yichen and He, Haonan and Cao, Zongsheng and Chen, Tao and Zhang, Bo and Ouyang, Wanli and Zhou, Bowen and Bai, Lei},
  year      = {2026},
  month     = aug,
  publisher = {MDPI AG},
  doi       = {10.20944/preprints202608.2038.v1},
  url       = {https://doi.org/10.20944/preprints202608.2038.v1}
}