GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

cstr/phi-3-orpo-v8_16-GGUF overview

phi 3 orpo v8 16 — GGUF GGUF conversion of microsoft/Phi 3 mini 4k instruct https://huggingface.co/microsoft/Phi 3 mini 4k instruct . Phi 3 mini ORPO fine tune…

ggufllmbase_model:microsoft/Phi-3-mini-4k-instructbase_model:quantized:microsoft/Phi-3-mini-4k-instructlicense:mitendpoints_compatibleregion:usconversational

Runs locally from ~2.16 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
77
Likes
0
Pipeline
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
phi-3-orpo-v8_16-q4-k-m.ggufGGUFQ42.16 GBDownload

Model Details

Model IDcstr/phi-3-orpo-v8_16-GGUF
Authorcstr
Pipeline
Licensemit
Base modelmicrosoft/Phi-3-mini-4k-instruct
Last modified2026-08-02T15:36:20.000Z

Model README

---

license: mit

tags:

- gguf

- llm

base_model: microsoft/Phi-3-mini-4k-instruct

---

phi-3-orpo-v8_16 — GGUF

GGUF conversion of microsoft/Phi-3-mini-4k-instruct. Phi-3 mini ORPO fine-tune v8.

Files

| File | Size |

|------|------|

| phi-3-orpo-v8_16-q4-k-m.gguf | 2211 MB |

Compatible with llama.cpp and other GGUF runtimes.

Provenance and EU AI Act Art. 53 note

  • Base model: cstr/phi-3-orpo-v8_16 — a ORPO fine-tune published by the same maintainer as this repository. It is not a third-party upstream: the maintainer authored that model.
  • What was done here: format conversion and/or quantisation of that base model only (GGUF). No further training, fine-tuning or merging was applied at this step.
  • Licence: mit, inherited through the base model from the models it was built from.
  • Training data: none was used, added or selected at this conversion step. The base model's card lists the models it was built from; their training content is documented — where it is documented at all — by their respective providers.
  • Provider status: under Regulation (EU) 2024/1689 this repository makes no provider claim for the conversion step. Any provider obligations attaching to the model itself — including Art. 53(1)(c) copyright policy and Art. 53(1)(d) training-content summary — attach at cstr/phi-3-orpo-v8_16, not here.

Run cstr/phi-3-orpo-v8_16-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models