afrideva/phi-2-sft-dpo-gpt4_en-ep1-gguf Q5_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
afrideva/phi-2-sft-dpo-gpt4_en-ep1-gguf overview
Yhyu13/phi-2-sft-dpo-gpt4en-ep1-GGUF Quantized GGUF model files for phi-2-sft-dpo-gpt4en-ep1 from Yhyu13 | Name | Quant method | Size | | ---- | ---- | ---- | | phi-2-sft-dpo-gpt4en-ep1.fp16.gguf | fp16 | 5.56 GB | | phi-2-sft-dpo-gpt4en-ep1.q2k.gguf | q2k | 1.17 GB | | phi-2-sft-dpo-gpt4en-ep1.q3km.gguf | q3km | 1.48 GB | | phi-2-sft-dpo-gpt4en-ep1.q4km.gguf | q4km | 1.79 GB | | phi-2-sft-dpo-gpt4en-ep1.q5km.gguf | q5km | 2.07 GB | | phi-2-sft-dpo-gpt4en-ep1.q6k.gguf | q6k | 2.29 GB | | phi-2-sft-dpo-gpt4en-ep1.q80.gguf | q8_0 | 2.96 GB |
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| phi-2-sft-dpo-gpt4_en-ep1.fp16.gguf | GGUF | — | 5.18 GB | Download |
| phi-2-sft-dpo-gpt4_en-ep1.q2_k.gguf | GGUF | Q2_K | 1.09 GB | Download |
| phi-2-sft-dpo-gpt4_en-ep1.q3_k_m.gguf | GGUF | Q3_K_M | 1.38 GB | Download |
| phi-2-sft-dpo-gpt4_en-ep1.q4_k_m.gguf | GGUF | Q4_K_M | 1.67 GB | Download |
| phi-2-sft-dpo-gpt4_en-ep1.q5_k_m.gguf | GGUF | Q5_K_M | 1.93 GB | Download |
| phi-2-sft-dpo-gpt4_en-ep1.q6_k.gguf | GGUF | Q6_K | 2.13 GB | Download |
| phi-2-sft-dpo-gpt4_en-ep1.q8_0.gguf | GGUF | — | 2.75 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"base_model": "Yhyu13/phi-2-sft-dpo-gpt4_en-ep1",
"inference": false,
"license": "other",
"license_link": "https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE",
"license_name": "microsoft-research-license",
"model_creator": "Yhyu13",
"model_name": "phi-2-sft-dpo-gpt4_en-ep1",
"pipeline_tag": "text-generation",
"quantized_by": "afrideva",
"tags": [
"gguf",
"ggml",
"quantized",
"q2_k",
"q3_k_m",
"q4_k_m",
"q5_k_m",
"q6_k",
"q8_0"
],
"frontmatter": {
"base_model": "Yhyu13/phi-2-sft-dpo-gpt4_en-ep1",
"inference": "false",
"license": "other",
"license_link": "https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE",
"license_name": "microsoft-research-license",
"model_creator": "Yhyu13",
"model_name": "phi-2-sft-dpo-gpt4_en-ep1",
"pipeline_tag": "text-generation",
"quantized_by": "afrideva",
"tags": [
"gguf",
"ggml",
"quantized",
"q2_k",
"q3_k_m",
"q4_k_m",
"q5_k_m",
"q6_k",
"q8_0"
]
},
"hero_image_url": "",
"summary": "# Yhyu13/phi-2-sft-dpo-gpt4_en-ep1-GGUF Quantized GGUF model files for phi-2-sft-dpo-gpt4_en-ep1 from Yhyu13 | Name | Quant method | Size | | ---- | ---- | ---- | | phi-2-sft-dpo-gpt4_en-ep1.fp16.gguf | fp16 | 5.56 GB | | phi-2-sft-dpo-gpt4_en-ep1.q2_k.gguf | q2_k | 1.17 GB | | phi-2-sft-dpo-gpt4_en-ep1.q3_k_m.gguf | q3_k_m | 1.48 GB | | phi-2-sft-dpo-gpt4_en-ep1.q4_k_m.gguf | q4_k_m | 1.79 GB | | phi-2-sft-dpo-gpt4_en-ep1.q5_k_m.gguf | q5_k_m | 2.07 GB | | phi-2-sft-dpo-gpt4_en-ep1.q6_k.gguf | q6_k | 2.29 GB | | phi-2-sft-dpo-gpt4_en-ep1.q8_0.gguf | q8_0 | 2.96 GB |",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nbase_model: Yhyu13/phi-2-sft-dpo-gpt4_en-ep1\ninference: false\nlicense: other\nlicense_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE\nlicense_name: microsoft-research-license\nmodel_creator: Yhyu13\nmodel_name: phi-2-sft-dpo-gpt4_en-ep1\npipeline_tag: text-generation\nquantized_by: afrideva\ntags:\n- gguf\n- ggml\n- quantized\n- q2_k\n- q3_k_m\n- q4_k_m\n- q5_k_m\n- q6_k\n- q8_0\n---\n# Yhyu13/phi-2-sft-dpo-gpt4_en-ep1-GGUF\n\nQuantized GGUF model files for [phi-2-sft-dpo-gpt4_en-ep1](https://huggingface.co/Yhyu13/phi-2-sft-dpo-gpt4_en-ep1) from [Yhyu13](https://huggingface.co/Yhyu13)\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [phi-2-sft-dpo-gpt4_en-ep1.fp16.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.fp16.gguf) | fp16 | 5.56 GB |\n| [phi-2-sft-dpo-gpt4_en-ep1.q2_k.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q2_k.gguf) | q2_k | 1.17 GB |\n| [phi-2-sft-dpo-gpt4_en-ep1.q3_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q3_k_m.gguf) | q3_k_m | 1.48 GB |\n| [phi-2-sft-dpo-gpt4_en-ep1.q4_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q4_k_m.gguf) | q4_k_m | 1.79 GB |\n| [phi-2-sft-dpo-gpt4_en-ep1.q5_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q5_k_m.gguf) | q5_k_m | 2.07 GB |\n| [phi-2-sft-dpo-gpt4_en-ep1.q6_k.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q6_k.gguf) | q6_k | 2.29 GB |\n| [phi-2-sft-dpo-gpt4_en-ep1.q8_0.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q8_0.gguf) | q8_0 | 2.96 GB |\n\n\n\n## Original Model Card:\nThis is the merged model for LoRA https://huggingface.co/Yhyu13/phi-2-sft-dpo-gpt4_en-ep1-lora\n\nThis model is a dpo improvement to this base model https://huggingface.co/Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1 who achieve better than text-davinci-003 on AlpcaEval judged by ChatGPT.",
"related_quantizations": []
},
"tags": [
"gguf",
"ggml",
"quantized",
"q2_k",
"q3_k_m",
"q4_k_m",
"q5_k_m",
"q6_k",
"q8_0",
"text-generation",
"base_model:Yhyu13/phi-2-sft-dpo-gpt4_en-ep1",
"base_model:quantized:Yhyu13/phi-2-sft-dpo-gpt4_en-ep1",
"license:other",
"region:us"
],
"likes": 2,
"downloads": 213,
"gated": false,
"private": false,
"last_modified": "2023-12-22T19:45:13.000Z",
"created_at": "2023-12-22T19:37:38.000Z",
"pipeline_tag": "text-generation",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "6585e582e92bc5f2581716ed",
"id": "afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF",
"modelId": "afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF",
"sha": "bfbd6a708830cc6736d747c7f848bceca4d38866",
"createdAt": "2023-12-22T19:37:38.000Z",
"lastModified": "2023-12-22T19:45:13.000Z",
"author": "afrideva",
"downloads": 213,
"likes": 2,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "",
"siblings_count": 9
}