afrideva/phi-2-sft-alpaca_gpt4_en-ep1-gguf overview

{
  "metadata": {},
  "card_data": {
    "base_model": "Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1",
    "inference": false,
    "license": "other",
    "license_link": "https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE",
    "license_name": "microsoft-research-license",
    "model_creator": "Yhyu13",
    "model_name": "phi-2-sft-alpaca_gpt4_en-ep1",
    "pipeline_tag": "text-generation",
    "quantized_by": "afrideva",
    "tags": [
      "gguf",
      "ggml",
      "quantized",
      "q2_k",
      "q3_k_m",
      "q4_k_m",
      "q5_k_m",
      "q6_k",
      "q8_0"
    ],
    "frontmatter": {
      "base_model": "Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1",
      "inference": "false",
      "license": "other",
      "license_link": "https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE",
      "license_name": "microsoft-research-license",
      "model_creator": "Yhyu13",
      "model_name": "phi-2-sft-alpaca_gpt4_en-ep1",
      "pipeline_tag": "text-generation",
      "quantized_by": "afrideva",
      "tags": [
        "gguf",
        "ggml",
        "quantized",
        "q2_k",
        "q3_k_m",
        "q4_k_m",
        "q5_k_m",
        "q6_k",
        "q8_0"
      ]
    },
    "hero_image_url": "",
    "summary": "# Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1-GGUF Quantized GGUF model files for phi-2-sft-alpaca_gpt4_en-ep1 from Yhyu13 | Name | Quant method | Size | | ---- | ---- | ---- | | phi-2-sft-alpaca_gpt4_en-ep1.fp16.gguf | fp16 | 5.56 GB  | | phi-2-sft-alpaca_gpt4_en-ep1.q2_k.gguf | q2_k | 1.17 GB  | | phi-2-sft-alpaca_gpt4_en-ep1.q3_k_m.gguf | q3_k_m | 1.48 GB  | | phi-2-sft-alpaca_gpt4_en-ep1.q4_k_m.gguf | q4_k_m | 1.79 GB  | | phi-2-sft-alpaca_gpt4_en-ep1.q5_k_m.gguf | q5_k_m | 2.07 GB  | | phi-2-sft-alpaca_gpt4_en-ep1.q6_k.gguf | q6_k | 2.29 GB  | | phi-2-sft-alpaca_gpt4_en-ep1.q8_0.gguf | q8_0 | 2.96 GB  |",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1\ninference: false\nlicense: other\nlicense_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE\nlicense_name: microsoft-research-license\nmodel_creator: Yhyu13\nmodel_name: phi-2-sft-alpaca_gpt4_en-ep1\npipeline_tag: text-generation\nquantized_by: afrideva\ntags:\n- gguf\n- ggml\n- quantized\n- q2_k\n- q3_k_m\n- q4_k_m\n- q5_k_m\n- q6_k\n- q8_0\n---\n# Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1-GGUF\n\nQuantized GGUF model files for [phi-2-sft-alpaca_gpt4_en-ep1](https://huggingface.co/Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1) from [Yhyu13](https://huggingface.co/Yhyu13)\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [phi-2-sft-alpaca_gpt4_en-ep1.fp16.gguf](https://huggingface.co/afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-alpaca_gpt4_en-ep1.fp16.gguf) | fp16 | 5.56 GB  |\n| [phi-2-sft-alpaca_gpt4_en-ep1.q2_k.gguf](https://huggingface.co/afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-alpaca_gpt4_en-ep1.q2_k.gguf) | q2_k | 1.17 GB  |\n| [phi-2-sft-alpaca_gpt4_en-ep1.q3_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-alpaca_gpt4_en-ep1.q3_k_m.gguf) | q3_k_m | 1.48 GB  |\n| [phi-2-sft-alpaca_gpt4_en-ep1.q4_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-alpaca_gpt4_en-ep1.q4_k_m.gguf) | q4_k_m | 1.79 GB  |\n| [phi-2-sft-alpaca_gpt4_en-ep1.q5_k_m.gguf](https://huggingface.co/afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-alpaca_gpt4_en-ep1.q5_k_m.gguf) | q5_k_m | 2.07 GB  |\n| [phi-2-sft-alpaca_gpt4_en-ep1.q6_k.gguf](https://huggingface.co/afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-alpaca_gpt4_en-ep1.q6_k.gguf) | q6_k | 2.29 GB  |\n| [phi-2-sft-alpaca_gpt4_en-ep1.q8_0.gguf](https://huggingface.co/afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF/resolve/main/phi-2-sft-alpaca_gpt4_en-ep1.q8_0.gguf) | q8_0 | 2.96 GB  |\n\n\n\n## Original Model Card:\nThis is the merged model for LoRA https://huggingface.co/Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1-lora\n\n---\n\nFrom this\nhttps://huggingface.co/microsoft/phi-2/discussions/38\n\nSince phi2 requires remote code which HF open llm leaderboard would not accept at this moment,\n\nI ran phi2 and my sft to the AlpcaEval benchmark\n\nhttps://tatsu-lab.github.io/alpaca_eval/\n\nHere is result evaluated by chatpgpt https://github.com/tatsu-lab/alpaca_eval/pull/183\n\n```\n                       win_rate  standard_error  n_total  avg_length\ngpt4                      73.79            1.54      805        1365\nclaude                    70.37            1.60      805        1082\nchatgpt                   66.09            1.66      805         811\nwizardlm-13b              65.16            1.67      805         985\nvicuna-13b                64.10            1.69      805        1037\nguanaco-65b               62.36            1.71      805        1249\noasst-rlhf-llama-33b      62.05            1.71      805        1079\nalpaca-farm-ppo-human     60.25            1.72      805         803\nfalcon-40b-instruct       56.52            1.74      805         662\nphi-2-alpaca-gpt4(new)    54.23            1.75      804        1138\ntext_davinci_003          50.00            0.00      805         307\nalpaca-7b                 45.22            1.74      805         396\nphi-2(new)                43.79            1.74      805         924\ntext_davinci_001          28.07            1.56      805         296\n```\n\nIt could be a milestone for small models, we finally have one open model can run for everyone which surpass GPT3.5!",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "ggml",
    "quantized",
    "q2_k",
    "q3_k_m",
    "q4_k_m",
    "q5_k_m",
    "q6_k",
    "q8_0",
    "text-generation",
    "base_model:Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1",
    "base_model:quantized:Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1",
    "license:other",
    "region:us"
  ],
  "likes": 4,
  "downloads": 128,
  "gated": false,
  "private": false,
  "last_modified": "2023-12-21T00:17:28.000Z",
  "created_at": "2023-12-21T00:09:21.000Z",
  "pipeline_tag": "text-generation",
  "library_name": ""
}

{
  "_id": "6583823192a21e76945b0389",
  "id": "afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF",
  "modelId": "afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF",
  "sha": "cbd24331098b546b626a4a4e1a5af317d6ff1230",
  "createdAt": "2023-12-21T00:09:21.000Z",
  "lastModified": "2023-12-21T00:17:28.000Z",
  "author": "afrideva",
  "downloads": 128,
  "likes": 4,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "",
  "siblings_count": 9
}