Model Intelligence Sheet
gghfez/Mistral-Medium-3.5-128B-IQ4_KT-GGUF overview
gghfez/Mistral-Medium-3.5-128B-IQ4_KT-GGUF GGUF downloads for local AI inference with guIDE.
Runs locally from ~152.4 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
6 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Mistral-Medium-3.5-128B-00001-of-00006.gguf | GGUF | GGUF | 11.68 GB | Download |
| Mistral-Medium-3.5-128B-00002-of-00006.gguf | GGUF | GGUF | 11.65 GB | Download |
| Mistral-Medium-3.5-128B-00003-of-00006.gguf | GGUF | GGUF | 11.65 GB | Download |
| Mistral-Medium-3.5-128B-00004-of-00006.gguf | GGUF | GGUF | 12.16 GB | Download |
| Mistral-Medium-3.5-128B-00005-of-00006.gguf | GGUF | GGUF | 11.65 GB | Download |
| Mistral-Medium-3.5-128B-00006-of-00006.gguf | GGUF | GGUF | 152.4 MB | Download |
Model Details
Run gghfez/Mistral-Medium-3.5-128B-IQ4_KT-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models