Model Intelligence Sheet
cstr/phi-3-orpo-v8_16-GGUF overview
phi 3 orpo v8 16 — GGUF GGUF conversion of microsoft/Phi 3 mini 4k instruct https://huggingface.co/microsoft/Phi 3 mini 4k instruct . Phi 3 mini ORPO fine tune…
Runs locally from ~2.16 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
1 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| phi-3-orpo-v8_16-q4-k-m.gguf | GGUF | Q4 | 2.16 GB | Download |
Model Details
Model README
---
license: mit
tags:
- gguf
- llm
base_model: microsoft/Phi-3-mini-4k-instruct
---
phi-3-orpo-v8_16 — GGUF
GGUF conversion of microsoft/Phi-3-mini-4k-instruct. Phi-3 mini ORPO fine-tune v8.
Files
| File | Size |
|------|------|
| phi-3-orpo-v8_16-q4-k-m.gguf | 2211 MB |
Compatible with llama.cpp and other GGUF runtimes.
Provenance and EU AI Act Art. 53 note
- Base model: cstr/phi-3-orpo-v8_16 — a ORPO fine-tune published by the same maintainer as this repository. It is not a third-party upstream: the maintainer authored that model.
- What was done here: format conversion and/or quantisation of that base model only (GGUF). No further training, fine-tuning or merging was applied at this step.
- Licence:
mit, inherited through the base model from the models it was built from. - Training data: none was used, added or selected at this conversion step. The base model's card lists the models it was built from; their training content is documented — where it is documented at all — by their respective providers.
- Provider status: under Regulation (EU) 2024/1689 this repository makes no provider claim for the conversion step. Any provider obligations attaching to the model itself — including Art. 53(1)(c) copyright policy and Art. 53(1)(d) training-content summary — attach at cstr/phi-3-orpo-v8_16, not here.
Run cstr/phi-3-orpo-v8_16-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models