Model Intelligence Sheet
Sciguy429/Hy3-128GB-GGUF overview
WIP, still uploading This is a tuned quant mix based https://huggingface.co/YanissAmz/Hy3 295B A21B GGUF heavily optmized for 128GB system RAM + 24GB VRAM.
Runs locally from ~4.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
21 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| SC128-V2/Hy3-SC128-V2-00001-of-00005.gguf | GGUF | GGUF | 4.8 MB | Download |
| SC128-V2/Hy3-SC128-V2-00002-of-00005.gguf | GGUF | GGUF | 29.39 GB | Download |
| SC128-V2/Hy3-SC128-V2-00003-of-00005.gguf | GGUF | GGUF | 29.70 GB | Download |
| SC128-V2/Hy3-SC128-V2-00004-of-00005.gguf | GGUF | GGUF | 29.70 GB | Download |
| SC128-V2/Hy3-SC128-V2-00005-of-00005.gguf | GGUF | GGUF | 29.63 GB | Download |
| SC128-V3/Hy3-SC128-V3-00001-of-00005.gguf | GGUF | GGUF | 4.8 MB | Download |
| SC128-V3/Hy3-SC128-V3-00002-of-00005.gguf | GGUF | GGUF | 29.49 GB | Download |
| SC128-V3/Hy3-SC128-V3-00003-of-00005.gguf | GGUF | GGUF | 29.33 GB | Download |
| SC128-V3/Hy3-SC128-V3-00004-of-00005.gguf | GGUF | GGUF | 29.75 GB | Download |
| SC128-V3/Hy3-SC128-V3-00005-of-00005.gguf | GGUF | GGUF | 26.38 GB | Download |
| SC128-V4/Hy3-SC128-V4-00001-of-00006.gguf | GGUF | GGUF | 4.8 MB | Download |
| SC128-V4/Hy3-SC128-V4-00002-of-00006.gguf | GGUF | GGUF | 29.49 GB | Download |
| SC128-V4/Hy3-SC128-V4-00003-of-00006.gguf | GGUF | GGUF | 29.33 GB | Download |
| SC128-V4/Hy3-SC128-V4-00004-of-00006.gguf | GGUF | GGUF | 29.57 GB | Download |
| SC128-V4/Hy3-SC128-V4-00005-of-00006.gguf | GGUF | GGUF | 29.55 GB | Download |
| SC128-V4/Hy3-SC128-V4-00006-of-00006.gguf | GGUF | GGUF | 447.4 MB | Download |
| UD128-BF16_RQ/Hy3-UD128-BF16_RQ-00001-of-00005.gguf | GGUF | BF16 | 4.8 MB | Download |
| UD128-BF16_RQ/Hy3-UD128-BF16_RQ-00002-of-00005.gguf | GGUF | BF16 | 29.59 GB | Download |
| UD128-BF16_RQ/Hy3-UD128-BF16_RQ-00003-of-00005.gguf | GGUF | BF16 | 29.57 GB | Download |
| UD128-BF16_RQ/Hy3-UD128-BF16_RQ-00004-of-00005.gguf | GGUF | BF16 | 29.57 GB | Download |
| UD128-BF16_RQ/Hy3-UD128-BF16_RQ-00005-of-00005.gguf | GGUF | BF16 | 18.28 GB | Download |
Model Details
Model README
---
base_model:
- tencent/Hy3
---
WIP, still uploading!
This is a tuned quant mix based https://huggingface.co/YanissAmz/Hy3-295B-A21B-GGUF heavily optmized for 128GB system RAM + 24GB VRAM.
Run Sciguy429/Hy3-128GB-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models