bagel-dpo-7b-v0.5 — GGUF

GGUF conversion of jondurbin/bagel-dpo-7b-v0.5. Bagel DPO 7B multi-task model.

Files

| File | Size |

|------|------|

| bagel-dpo-7b-v0.5-q4-k-m.gguf | 4166 MB |

Compatible with llama.cpp and other GGUF runtimes.

Upstream model: jondurbin/bagel-dpo-7b-v0.5 — published by jondurbin.
Upstream licence: apache-2.0. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
What was done here: format conversion and/or quantisation only (GGUF). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.

Question 2

What license applies to cstr/bagel-dpo-7b-v0.5-GGUF?

Accepted Answer

License: apache-2.0. Verify terms on Hugging Face before commercial use.

Question 3

How do I run cstr/bagel-dpo-7b-v0.5-GGUF locally?

Accepted Answer

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Question 4

How much VRAM or disk space does cstr/bagel-dpo-7b-v0.5-GGUF need?

Accepted Answer

Runs locally from ~4.07 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).