GraySoft
Projects Models About FAQ Contact Download guIDE →

afrideva/phi-2-sft-dpo-gpt4_en-ep1-gguf Q5_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

afrideva/phi-2-sft-dpo-gpt4_en-ep1-gguf overview

Yhyu13/phi-2-sft-dpo-gpt4en-ep1-GGUF Quantized GGUF model files for phi-2-sft-dpo-gpt4en-ep1 from Yhyu13 | Name | Quant method | Size | | ---- | ---- | ---- | | phi-2-sft-dpo-gpt4en-ep1.fp16.gguf | fp16 | 5.56 GB | | phi-2-sft-dpo-gpt4en-ep1.q2k.gguf | q2k | 1.17 GB | | phi-2-sft-dpo-gpt4en-ep1.q3km.gguf | q3km | 1.48 GB | | phi-2-sft-dpo-gpt4en-ep1.q4km.gguf | q4km | 1.79 GB | | phi-2-sft-dpo-gpt4en-ep1.q5km.gguf | q5km | 2.07 GB | | phi-2-sft-dpo-gpt4en-ep1.q6k.gguf | q6k | 2.29 GB | | phi-2-sft-dpo-gpt4en-ep1.q80.gguf | q8_0 | 2.96 GB |

ggufggmlquantizedq2_kq3_k_mq4_k_mq5_k_mq6_kq8_0text-generationbase_model:Yhyu13/phi-2-sft-dpo-gpt4_en-ep1base_model:quantized:Yhyu13/phi-2-sft-dpo-gpt4_en-ep1license:otherregion:us
afrideva/phi-2-sft-dpo-gpt4_en-ep1-gguf visual
Downloads
213
Likes
2
Pipeline
text-generation
Library
Visibility
Public
Access
Open

Repository Files & Downloads

7 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
phi-2-sft-dpo-gpt4_en-ep1.fp16.gguf GGUF 5.18 GB Download
phi-2-sft-dpo-gpt4_en-ep1.q2_k.gguf GGUF Q2_K 1.09 GB Download
phi-2-sft-dpo-gpt4_en-ep1.q3_k_m.gguf GGUF Q3_K_M 1.38 GB Download
phi-2-sft-dpo-gpt4_en-ep1.q4_k_m.gguf GGUF Q4_K_M 1.67 GB Download
phi-2-sft-dpo-gpt4_en-ep1.q5_k_m.gguf GGUF Q5_K_M 1.93 GB Download
phi-2-sft-dpo-gpt4_en-ep1.q6_k.gguf GGUF Q6_K 2.13 GB Download
phi-2-sft-dpo-gpt4_en-ep1.q8_0.gguf GGUF 2.75 GB Download

Model Details Live

Model Slug
afrideva/phi-2-sft-dpo-gpt4_en-ep1-gguf
Author
afrideva
Pipeline Task
text-generation
Library
Created
2023-12-22
Last Modified
2023-12-22
Gated
No
Private
No
HF SHA
bfbd6a708830cc6736d747c7f848bceca4d38866
License
other
Language
Unknown
Base Model
Yhyu13/phi-2-sft-dpo-gpt4_en-ep1

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": "Yhyu13/phi-2-sft-dpo-gpt4_en-ep1",
    "inference": false,
    "license": "other",
    "license_link": "https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE",
    "license_name": "microsoft-research-license",
    "model_creator": "Yhyu13",
    "model_name": "phi-2-sft-dpo-gpt4_en-ep1",
    "pipeline_tag": "text-generation",
    "quantized_by": "afrideva",
    "tags": [
      "gguf",
      "ggml",
      "quantized",
      "q2_k",
      "q3_k_m",
      "q4_k_m",
      "q5_k_m",
      "q6_k",
      "q8_0"
    ],
    "frontmatter": {
      "base_model": "Yhyu13/phi-2-sft-dpo-gpt4_en-ep1",
      "inference": "false",
      "license": "other",
      "license_link": "https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE",
      "license_name": "microsoft-research-license",
      "model_creator": "Yhyu13",
      "model_name": "phi-2-sft-dpo-gpt4_en-ep1",
      "pipeline_tag": "text-generation",
      "quantized_by": "afrideva",
      "tags": [
        "gguf",
        "ggml",
        "quantized",
        "q2_k",
        "q3_k_m",
        "q4_k_m",
        "q5_k_m",
        "q6_k",
        "q8_0"
      ]
    },
    "hero_image_url": "",
    "summary": "# Yhyu13/phi-2-sft-dpo-gpt4_en-ep1-GGUF Quantized GGUF model files for phi-2-sft-dpo-gpt4_en-ep1 from Yhyu13 | Name | Quant method | Size | | ---- | ---- | ---- | | phi-2-sft-dpo-gpt4_en-ep1.fp16.gguf | fp16 | 5.56 GB  | | phi-2-sft-dpo-gpt4_en-ep1.q2_k.gguf | q2_k | 1.17 GB  | | phi-2-sft-dpo-gpt4_en-ep1.q3_k_m.gguf | q3_k_m | 1.48 GB  | | phi-2-sft-dpo-gpt4_en-ep1.q4_k_m.gguf | q4_k_m | 1.79 GB  | | phi-2-sft-dpo-gpt4_en-ep1.q5_k_m.gguf | q5_k_m | 2.07 GB  | | phi-2-sft-dpo-gpt4_en-ep1.q6_k.gguf | q6_k | 2.29 GB  | | phi-2-sft-dpo-gpt4_en-ep1.q8_0.gguf | q8_0 | 2.96 GB  |",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: Yhyu13/phi-2-sft-dpo-gpt4_en-ep1\ninference: false\nlicense: other\nlicense_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE\nlicense_name: microsoft-research-license\nmodel_creator: Yhyu13\nmodel_name: phi-2-sft-dpo-gpt4_en-ep1\npipeline_tag: text-generation\nquantized_by: afrideva\ntags:\n- gguf\n- ggml\n- quantized\n- q2_k\n- q3_k_m\n- q4_k_m\n- q5_k_m\n- q6_k\n- q8_0\n---\n# Yhyu13/phi-2-sft-dpo-gpt4_en-ep1-GGUF\n\nQuantized GGUF model files for [phi-2-sft-dpo-gpt4_en-ep1](https://huggingface.co/Yhyu13/phi-2-sft-dpo-gpt4_en-ep1) from [Yhyu13](https://huggingface.co/Yhyu13)\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [phi-2-sft-dpo-gpt4_en-ep1.fp16.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.fp16.gguf) | fp16 | 5.56 GB  |\n| [phi-2-sft-dpo-gpt4_en-ep1.q2_k.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q2_k.gguf) | q2_k | 1.17 GB  |\n| [phi-2-sft-dpo-gpt4_en-ep1.q3_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q3_k_m.gguf) | q3_k_m | 1.48 GB  |\n| [phi-2-sft-dpo-gpt4_en-ep1.q4_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q4_k_m.gguf) | q4_k_m | 1.79 GB  |\n| [phi-2-sft-dpo-gpt4_en-ep1.q5_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q5_k_m.gguf) | q5_k_m | 2.07 GB  |\n| [phi-2-sft-dpo-gpt4_en-ep1.q6_k.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q6_k.gguf) | q6_k | 2.29 GB  |\n| [phi-2-sft-dpo-gpt4_en-ep1.q8_0.gguf](https://huggingface.co/afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-dpo-gpt4_en-ep1.q8_0.gguf) | q8_0 | 2.96 GB  |\n\n\n\n## Original Model Card:\nThis is the merged model for LoRA https://huggingface.co/Yhyu13/phi-2-sft-dpo-gpt4_en-ep1-lora\n\nThis model is a dpo improvement to this base model https://huggingface.co/Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1 who achieve better than text-davinci-003 on AlpcaEval judged by ChatGPT.",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "ggml",
    "quantized",
    "q2_k",
    "q3_k_m",
    "q4_k_m",
    "q5_k_m",
    "q6_k",
    "q8_0",
    "text-generation",
    "base_model:Yhyu13/phi-2-sft-dpo-gpt4_en-ep1",
    "base_model:quantized:Yhyu13/phi-2-sft-dpo-gpt4_en-ep1",
    "license:other",
    "region:us"
  ],
  "likes": 2,
  "downloads": 213,
  "gated": false,
  "private": false,
  "last_modified": "2023-12-22T19:45:13.000Z",
  "created_at": "2023-12-22T19:37:38.000Z",
  "pipeline_tag": "text-generation",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "6585e582e92bc5f2581716ed",
  "id": "afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF",
  "modelId": "afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF",
  "sha": "bfbd6a708830cc6736d747c7f848bceca4d38866",
  "createdAt": "2023-12-22T19:37:38.000Z",
  "lastModified": "2023-12-22T19:45:13.000Z",
  "author": "afrideva",
  "downloads": 213,
  "likes": 2,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "",
  "siblings_count": 9
}