AI4SGI/ExoMind-9B-F16-GGUF overview
<div align="center" <img src="./assets/ExoMind.png" alt="ExoMind" width="560" ExoMind: Democratizing Scientific Intelligence via Extended Mind Inspired Agentic…
Runs locally from ~875.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | AI4SGI/ExoMind-9B-F16-GGUF |
|---|---|
| Author | AI4SGI |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | AI4SGI/ExoMind-9B |
| Last modified | 2026-09-01T09:00:46.000Z |
Model README
---
library_name: llama.cpp
license: apache-2.0
base_model: AI4SGI/ExoMind-9B
base_model_relation: quantized
pipeline_tag: image-text-to-text
tags:
- exomind
- gguf
- llama-cpp
- f16
- scientific-reasoning
- agentic
- tool-use
- multimodal
- qwen3.5
---
<div align="center">
<img src="./assets/ExoMind.png" alt="ExoMind" width="560">
ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System
ExoMind Team · Shanghai Artificial Intelligence Laboratory
<p>
<a href="https://ai4sgi.github.io/ExoMind/"><img src="https://img.shields.io/badge/Project_Page-Visit-174F87?style=for-the-badge&logo=googlechrome&logoColor=white" alt="Project Page"></a>
<a href="https://doi.org/10.20944/preprints202608.2038.v1"><img src="https://img.shields.io/badge/Paper-Preprint-B31B1B?style=for-the-badge&logo=adobeacrobatreader&logoColor=white" alt="ExoMind preprint"></a>
</p>
<p>
<a href="https://huggingface.co/AI4SGI/ExoMind-9B-F16-GGUF"><img src="https://img.shields.io/badge/Hugging_Face-Model-FFD21E?style=for-the-badge&logo=huggingface&logoColor=000000" alt="Hugging Face"></a>
<a href="https://github.com/AI4SGI/ExoMind"><img src="https://img.shields.io/badge/GitHub-Code-181717?style=for-the-badge&logo=github&logoColor=white" alt="GitHub"></a>
<a href="https://modelscope.cn/models/AI4SGI/ExoMind-9B-F16-GGUF"><img src="https://img.shields.io/badge/ModelScope-Model-624AFF?style=for-the-badge" alt="ModelScope"></a>
</p>
</div>
Overview
Reference-precision GGUF release of ExoMind-9B for local inference and downstream GGUF conversion.
This repository intentionally contains only the F16 model and
the matching multimodal projector. Keeping each precision in its own repository
makes downloads, local disk requirements, and deployment commands explicit.
Files
| File | Role | Download size |
| --- | --- | ---: |
| qwen3_5_9b-F16.gguf | F16 model | 16.69 GiB |
| mmproj-qwen3_5_9b-F16.gguf | F16 multimodal projector | 875.63 MiB |
Quick Start with llama.cpp
Text-only serving:
llama-server \
-m qwen3_5_9b-F16.gguf \
--ctx-size 32768 \
--host 0.0.0.0 \
--port 8080
For image input, load the projector shipped in this repository:
llama-server \
-m qwen3_5_9b-F16.gguf \
--mmproj mmproj-qwen3_5_9b-F16.gguf \
--ctx-size 32768 \
--host 0.0.0.0 \
--port 8080
Conversion Provenance
These GGUF files were supplied as existing release artifacts. Their exact filenames, byte sizes, and GGUF v3 headers were validated before publication, but the original HF-to-GGUF conversion and quantization commands were not retained with the files. The repository therefore does not claim bit-for-bit reproducibility of the original conversion pipeline.
Evaluation Boundary
The main ExoMind benchmark table reports the 35B-A3B system and must not be attributed to ExoMind-9B. This F16 GGUF has no separate scores.
Complete settings and comparisons are available in the
License and Attribution
The model files and upstream Qwen3.5 materials are distributed under the Apache
License 2.0 included with the model. Preprint text, scientific figures,
results, and ExoMind brand assets are governed by the
ExoMind Research Content and Brand Terms. See
NOTICE.md for third-party notices.
Citation
@article{Ye_2026,
title = {ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System},
author = {Ye, Peng and Liu, Zhuo and Ye, Jingqi and Yu, Fangchen and Tang, Shengji and Jiang, Yichen and He, Haonan and Cao, Zongsheng and Chen, Tao and Zhang, Bo and Ouyang, Wanli and Zhou, Bowen and Bai, Lei},
year = {2026},
month = aug,
publisher = {MDPI AG},
doi = {10.20944/preprints202608.2038.v1},
url = {https://doi.org/10.20944/preprints202608.2038.v1}
}Run AI4SGI/ExoMind-9B-F16-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models