duyntnet/westicelemontearp-32k-7b-imatrix-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "other",
    "inference": false,
    "language": [
      "en"
    ],
    "pipeline_tag": "text-generation",
    "tags": [
      "transformers",
      "gguf",
      "imatrix",
      "WestIceLemonTeaRP-32k-7b",
      "icefog72"
    ],
    "frontmatter": {
      "license": "other",
      "inference": "false",
      "language": [
        "en"
      ],
      "pipeline_tag": "text-generation",
      "tags": [
        "transformers",
        "gguf",
        "imatrix",
        "WestIceLemonTeaRP-32k-7b",
        "icefog72"
      ]
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/63407b719dbfe0d48b2d763b/GX-kV-H8_zAJz5hHL8A7G.png",
    "summary": "This is a merge of pre-trained language models created using mergekit.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: other\ninference: false\nlanguage:\n- en\npipeline_tag: text-generation\ntags:\n- transformers\n- gguf\n- imatrix\n- WestIceLemonTeaRP-32k-7b\n- icefog72\n---\nQuantizations of https://huggingface.co/icefog72/WestIceLemonTeaRP-32k-7b\n\n# From original readme\n\nThis is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).\n\n## Merge Details\n\nPrompt template: Alpaca, maybe ChatML\n\n* measurement.json for quanting exl2 included.\n\n- [4.2bpw-exl2](https://huggingface.co/icefog72/WestIceLemonTeaRP-32k-7b-4.2bpw-exl2)\n- [6.5bpw-exl2](https://huggingface.co/icefog72/WestIceLemonTeaRP-32k-7b-6.5bpw-exl2)\n- [8bpw-exl2](https://huggingface.co/icefog72/WestIceLemonTeaRP-32k-7b-8bpw-exl2)\n\n\nthx mradermacher and SilverFan for \n* [mradermacher/WestIceLemonTeaRP-32k-GGUF](https://huggingface.co/mradermacher/WestIceLemonTeaRP-32k-GGUF)\n* [SilverFan/WestIceLemonTeaRP-7b-32k-GGUF](https://huggingface.co/SilverFan/WestIceLemonTeaRP-7b-32k-GGUF)\n\n### Merge Method\n\nThis model was merged using the SLERP merge method.\n\n### Models Merged\n\nThe following models were included in the merge:\n* [IceLemonTeaRP-32k-7b](https://huggingface.co/icefog72/IceLemonTeaRP-32k-7b)\n* WestWizardIceLemonTeaRP\n  * [SeverusWestLake-7B-DPO](https://huggingface.co/s3nh/SeverusWestLake-7B-DPO)\n  * WizardIceLemonTeaRP\n    * [Not-WizardLM-2-7B](https://huggingface.co/amazingvince/Not-WizardLM-2-7B)\n    * [IceLemonTeaRP-32k-7b](https://huggingface.co/icefog72/IceLemonTeaRP-32k-7b)\n\n\n### Configuration\n\nThe following YAML configuration was used to produce this model:\n\n```yaml\n\nslices:\n  - sources:\n      - model: IceLemonTeaRP-32k-7b\n        layer_range: [0, 32]\n      - model: WestWizardIceLemonTeaRP\n        layer_range: [0, 32]\nmerge_method: slerp\nbase_model: IceLemonTeaRP-32k-7b\nparameters:\n  t:\n    - filter: self_attn\n      value: [0, 0.5, 0.3, 0.7, 1]\n    - filter: mlp\n      value: [1, 0.5, 0.7, 0.3, 0]\n    - value: 0.5\ndtype: float16\n```\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/63407b719dbfe0d48b2d763b/GX-kV-H8_zAJz5hHL8A7G.png)\n\n# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)\nDetailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_icefog72__WestIceLemonTeaRP-32k-7b)\n\n|             Metric              |Value|\n|---------------------------------|----:|\n|Avg.                             |71.27|\n|AI2 Reasoning Challenge (25-Shot)|68.77|\n|HellaSwag (10-Shot)              |86.89|\n|MMLU (5-Shot)                    |64.28|\n|TruthfulQA (0-shot)              |62.47|\n|Winogrande (5-shot)              |80.98|\n|GSM8k (5-shot)                   |64.22|\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "imatrix",
    "WestIceLemonTeaRP-32k-7b",
    "icefog72",
    "text-generation",
    "en",
    "license:other",
    "region:us"
  ],
  "likes": 0,
  "downloads": 139,
  "gated": false,
  "private": false,
  "last_modified": "2024-04-26T07:09:15.000Z",
  "created_at": "2024-04-24T13:56:53.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}

{
  "_id": "66290fa5f5c8d5f5b3850f35",
  "id": "duyntnet/WestIceLemonTeaRP-32k-7b-imatrix-GGUF",
  "modelId": "duyntnet/WestIceLemonTeaRP-32k-7b-imatrix-GGUF",
  "sha": "a3740bf65e0273692ac67069610d0e4c7b43b6cc",
  "createdAt": "2024-04-24T13:56:53.000Z",
  "lastModified": "2024-04-26T07:09:15.000Z",
  "author": "duyntnet",
  "downloads": 139,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 27
}