lewdiculous/fimbulvetr-11b-v2-gguf-iq-imatrix overview

{
  "metadata": {},
  "card_data": {
    "base_model": "Sao10K/Fimbulvetr-11B-v2",
    "language": [
      "en"
    ],
    "library_name": "transformers",
    "license": "cc-by-nc-4.0",
    "quantized_by": "Lewdiculous",
    "inference": false,
    "tags": [
      "roleplay"
    ],
    "frontmatter": {
      "base_model": "Sao10K/Fimbulvetr-11B-v2",
      "language": [
        "en"
      ],
      "library_name": "transformers",
      "license": "cc-by-nc-4.0",
      "quantized_by": "Lewdiculous",
      "inference": "false",
      "tags": [
        "roleplay"
      ]
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/jk8ImzfmM87y8e2FYT7Wv.webp",
    "summary": "Model imatrix quants as requested at **#36** for **Sao10K/Fimbulvetr-11B-v2**.  **Prompt Format:** Alpaca or Vicuna. An absolute **classic** and highly popular roleplay model, now with newer quants as requested directly. *Imatrix data was generated from the FP16-GGUF and conversions as well since the original model weights are already FP16.*  *Using the latest version of llama.cpp at the time - b2774.* !image/webp",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: Sao10K/Fimbulvetr-11B-v2\nlanguage:\n- en\nlibrary_name: transformers\nlicense: cc-by-nc-4.0\nquantized_by: Lewdiculous\ninference: false\ntags:\n- roleplay\n---\n\nModel imatrix quants as requested at [**#36**](https://huggingface.co/Lewdiculous/Model-Requests/discussions/36) for [**Sao10K/Fimbulvetr-11B-v2**](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2). <br>\n**Prompt Format:** Alpaca or Vicuna.\n\nAn absolute **classic** and highly popular roleplay model, now with newer quants as requested directly.\n\n*Imatrix data was generated from the FP16-GGUF and conversions as well since the original model weights are already FP16.* <br>\n*Using the latest version of llama.cpp at the time - b2774.*\n\n![image/webp](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/jk8ImzfmM87y8e2FYT7Wv.webp)\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "roleplay",
    "en",
    "base_model:Sao10K/Fimbulvetr-11B-v2",
    "base_model:quantized:Sao10K/Fimbulvetr-11B-v2",
    "license:cc-by-nc-4.0",
    "region:us",
    "imatrix"
  ],
  "likes": 26,
  "downloads": 409,
  "gated": false,
  "private": false,
  "last_modified": "2024-10-02T12:53:33.000Z",
  "created_at": "2024-06-03T04:33:39.000Z",
  "pipeline_tag": "",
  "library_name": "transformers"
}

{
  "_id": "665d47a320dee2925d1c46ee",
  "id": "Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix",
  "modelId": "Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix",
  "sha": "d32434c0675eea5f8d231a5cc94926341c5c9ac2",
  "createdAt": "2024-06-03T04:33:39.000Z",
  "lastModified": "2024-10-02T12:53:33.000Z",
  "author": "Lewdiculous",
  "downloads": 409,
  "likes": 26,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "transformers",
  "siblings_count": 14
}