Model Intelligence Sheet
cstr/Yi-1.5-9B-Chat-GGUF overview
quantized to GGUF format from 01 ai/Yi 1.5 9B Chat https://huggingface.co/01 ai/Yi 1.5 9B Chat using llama.cpp Provenance and EU AI Act Art. 53 note Upstream m…
Runs locally from ~4.96 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
1 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| yi-1.5-9b-chat.Q4_K_M.gguf | GGUF | GGUF | 4.96 GB | Download |
Model Details
Model README
---
license: apache-2.0
tags:
- llama-cpp
---
quantized to GGUF format from 01-ai/Yi-1.5-9B-Chat using llama.cpp
Provenance and EU AI Act Art. 53 note
- Upstream model: 01-ai/Yi-1.5-9B-Chat — published by
01-ai. - Upstream licence:
apache-2.0. This repository redistributes under the same terms; it grants no rights the upstream licence does not. - What was done here: format conversion and/or quantisation only (GGUF). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
- Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
- Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.
Run cstr/Yi-1.5-9B-Chat-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models