knifeayumu/cydonia-v1.2-magnum-v4-22b-gguf overview

{
  "metadata": {},
  "card_data": {
    "base_model": [
      "knifeayumu/Cydonia-v1.2-Magnum-v4-22B"
    ],
    "language": [
      "en"
    ],
    "license": "other",
    "license_name": "mrl",
    "license_link": "https://mistral.ai/licenses/MRL-0.1.md",
    "library_name": "transformers",
    "frontmatter": {
      "base_model": [
        "knifeayumu/Cydonia-v1.2-Magnum-v4-22B"
      ],
      "language": [
        "en"
      ],
      "license": "other",
      "license_name": "mrl",
      "license_link": "https://mistral.ai/licenses/MRL-0.1.md",
      "library_name": "transformers"
    },
    "hero_image_url": "https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B/resolve/main/Cydonia-v1.2-Magnum-v4-22B.png",
    "summary": "Recipe based on MarsupialAI/Monstral-123B. It should work since it's the same Mistral, TheDrummer and MarsupialAI, right? This is a merge of pre-trained language models created using mergekit.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model:\n- knifeayumu/Cydonia-v1.2-Magnum-v4-22B\nlanguage:\n- en\nlicense: other\nlicense_name: mrl\nlicense_link: https://mistral.ai/licenses/MRL-0.1.md\nlibrary_name: transformers\n---\n\n## Llamacpp Quantizations of knifeayumu/Cydonia-v1.2-Magnum-v4-22B\n\nUsing [llama.cpp](https://github.com/ggerganov/llama.cpp/) release [b3982](https://github.com/ggerganov/llama.cpp/releases/tag/b3982) for quantization.\n\nOriginal model: [knifeayumu/Cydonia-v1.2-Magnum-v4-22B](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B)\n\n## Quant Types:\n\n| Filename | Quant type | File Size |\n| -------- | ---------- | --------- |\n| [Cydonia-v1.2-Magnum-v4-22B-F16.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-F16.gguf) | F16 | 44.5 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q8_0.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q8_0.gguf) | Q8_0 | 23.6 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q6_K.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q6_K.gguf) | Q6_K | 18.3 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q5_K_M.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q5_K_M.gguf) | Q5_K_M | 15.7 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q5_K_S.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q5_K_S.gguf) | Q5_K_S | 15.3 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q4_K_M.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q4_K_M.gguf) | Q4_K_M | 13.3 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q4_K_S.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q4_K_S.gguf) | Q4_K_S | 12.7 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q3_K_L.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q3_K_L.gguf) | Q3_K_L | 11.7 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q3_K_M.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q3_K_M.gguf) | Q3_K_M | 10.8 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q3_K_S.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q3_K_S.gguf) | Q3_K_S | 9.64 GB |\n| [Cydonia-v1.2-Magnum-v4-22B-Q2_K.gguf](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF/blob/main/Cydonia-v1.2-Magnum-v4-22B-Q2_K.gguf) | Q2_K | 8.27 GB |\n\n\n![Not Horny Enough](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B/resolve/main/Cydonia-v1.2-Magnum-v4-22B.png)\n\n# The Drummer becomes hornier\n\nRecipe based on [MarsupialAI/Monstral-123B](https://huggingface.co/MarsupialAI/Monstral-123B). It should work since it's the same Mistral, TheDrummer and MarsupialAI, right?\n\nThis is a merge of pre-trained language models created using [mergekit](https://github.com/arcee-ai/mergekit).\n\n## Merge Details\n### Merge Method\n\nThis model was merged using the SLERP merge method.\n\n### Models Merged\n\nThe following models were included in the merge:\n* [TheDrummer/Cydonia-22B-v1.2](https://huggingface.co/TheDrummer/Cydonia-22B-v1.2)\n* [anthracite-org/magnum-v4-22b](https://huggingface.co/anthracite-org/magnum-v4-22b)\n\n### Configuration\n\nThe following YAML configuration was used to produce this model:\n\n```yaml\nmodels:\n  - model: TheDrummer/Cydonia-22B-v1.2\n  - model: anthracite-org/magnum-v4-22b\nmerge_method: slerp\nbase_model: TheDrummer/Cydonia-22B-v1.2\nparameters:\n  t: [0.1, 0.3, 0.6, 0.3, 0.1]\ndtype: bfloat16\n```",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "en",
    "base_model:knifeayumu/Cydonia-v1.2-Magnum-v4-22B",
    "base_model:quantized:knifeayumu/Cydonia-v1.2-Magnum-v4-22B",
    "license:other",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 4,
  "downloads": 636,
  "gated": false,
  "private": false,
  "last_modified": "2024-10-26T21:31:35.000Z",
  "created_at": "2024-10-26T15:31:27.000Z",
  "pipeline_tag": "",
  "library_name": "transformers"
}

{
  "_id": "671d0b4fee7e2ddd4fbafa19",
  "id": "knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF",
  "modelId": "knifeayumu/Cydonia-v1.2-Magnum-v4-22B-GGUF",
  "sha": "185b30faf409bd0a3dececb408c4458babcbe4c7",
  "createdAt": "2024-10-26T15:31:27.000Z",
  "lastModified": "2024-10-26T21:31:35.000Z",
  "author": "knifeayumu",
  "downloads": 636,
  "likes": 4,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "transformers",
  "siblings_count": 13
}