richarderkhov/fimbulvetr-11b-v2-gguf overview
GGUF quantization made by Richard Erkhov. Github Discord Request more models Fimbulvetr-11B-v2 - GGUF | Name | Quant method | Size | | ---- | ---- | ---- | | Fimbulvetr-11B-v2.Q2K.gguf | Q2K | 3.73GB | | Fimbulvetr-11B-v2.IQ3XS.gguf | IQ3XS | 4.14GB | | Fimbulvetr-11B-v2.IQ3S.gguf | IQ3S | 4.37GB | | Fimbulvetr-11B-v2.Q3KS.gguf | Q3KS | 4.34GB | | Fimbulvetr-11B-v2.IQ3M.gguf | IQ3M | 4.51GB | | Fimbulvetr-11B-v2.Q3K.gguf | Q3K | 4.84GB | | Fimbulvetr-11B-v2.Q3KM.gguf | Q3KM | 4.84GB | | Fimbulvetr-11B-v2.Q3KL.gguf | Q3KL | 5.26GB | | Fimbulvetr-11B-v2.IQ4XS.gguf | IQ4XS | 5.43GB | | Fimbulvetr-11B-v2.Q40.gguf | Q40 | 5.66GB | | Fimbulvetr-11B-v2.IQ4NL.gguf | IQ4NL | 5.72GB | | Fimbulvetr-11B-v2.Q4KS.gguf | Q4KS | 5.7GB | | Fimbulvetr-11B-v2.Q4K.gguf | Q4K | 6.02GB | | Fimbulvetr-11B-v2.Q4KM.gguf | Q4KM | 6.02GB | | Fimbulvetr-11B-v2.Q41.gguf | Q41 | 6.27GB | | Fimbulvetr-11B-v2.Q50.gguf | Q50 | 6.89GB | | Fimbulvetr-11B-v2.Q5KS.gguf | Q5KS | 6.89GB | | Fimbulvetr-11B-v2.Q5K.gguf | Q5K | 7.08GB | | Fimbulvetr-11B-v2.Q5KM.gguf | Q5KM | 7.08GB | | Fimbulvetr-11B-v2.Q51.gguf | Q51 | 7.51GB | | Fimbulvetr-11B-v2.Q6K.gguf | Q6K | 8.2GB | Original model description: --- license: cc-by-nc-4.0 language: --- !Fox1 Cute girl to catch your attention. https://huggingface.co/Sao10K/Fimbulvetr-11B-v2-GGUF ### Input: ### Response: System: User: Assistant: Changelogs: 25/2 - repo renamed to remove test, model card redone. Model's officially out. 15/2 - Heavy testing complete. Good feedback. * Rant - Kept For Historical Reasons Ramble to meet minimum length requirements: Tbh i wonder if this shit is even worth doing. Like im just some broke guy lmao I've spent so much. And for what? I guess creds. Feels good when a model gets good feedback, but it seems like im invisible sometimes. I should be probably advertising myself and my models on other places but I rarely have the time to. Probably just internal jealousy sparking up here and now. Wahtever I guess. Anyway cool EMT vocation I'm doing is cool except it pays peanuts, damn bruh 1.1k per month lmao. Government to broke to pay for shit. Pays the bills I suppose. Anyway cool beans, I'm either going to continue the Solar Train or go to Mixtral / Yi when I get paid. You still here?
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Fimbulvetr-11B-v2.IQ3_M.gguf | GGUF | IQ3_M | 4.51 GB | Download |
| Fimbulvetr-11B-v2.IQ3_S.gguf | GGUF | IQ3_S | 4.37 GB | Download |
| Fimbulvetr-11B-v2.IQ3_XS.gguf | GGUF | IQ3_XS | 4.14 GB | Download |
| Fimbulvetr-11B-v2.IQ4_NL.gguf | GGUF | IQ4_NL | 5.72 GB | Download |
| Fimbulvetr-11B-v2.IQ4_XS.gguf | GGUF | IQ4_XS | 5.43 GB | Download |
| Fimbulvetr-11B-v2.Q2_K.gguf | GGUF | Q2_K | 3.73 GB | Download |
| Fimbulvetr-11B-v2.Q3_K.gguf | GGUF | Q3_K | 4.84 GB | Download |
| Fimbulvetr-11B-v2.Q3_K_L.gguf | GGUF | Q3_K_L | 5.26 GB | Download |
| Fimbulvetr-11B-v2.Q3_K_M.gguf | GGUF | Q3_K_M | 4.84 GB | Download |
| Fimbulvetr-11B-v2.Q3_K_S.gguf | GGUF | Q3_K_S | 4.34 GB | Download |
| Fimbulvetr-11B-v2.Q4_0.gguf | GGUF | — | 5.66 GB | Download |
| Fimbulvetr-11B-v2.Q4_1.gguf | GGUF | — | 6.27 GB | Download |
| Fimbulvetr-11B-v2.Q4_K.gguf | GGUF | Q4_K | 6.02 GB | Download |
| Fimbulvetr-11B-v2.Q4_K_M.gguf | GGUF | Q4_K_M | 6.02 GB | Download |
| Fimbulvetr-11B-v2.Q4_K_S.gguf | GGUF | Q4_K_S | 5.70 GB | Download |
| Fimbulvetr-11B-v2.Q5_0.gguf | GGUF | — | 6.89 GB | Download |
| Fimbulvetr-11B-v2.Q5_1.gguf | GGUF | — | 7.51 GB | Download |
| Fimbulvetr-11B-v2.Q5_K.gguf | GGUF | Q5_K | 7.08 GB | Download |
| Fimbulvetr-11B-v2.Q5_K_M.gguf | GGUF | Q5_K_M | 7.08 GB | Download |
| Fimbulvetr-11B-v2.Q5_K_S.gguf | GGUF | Q5_K_S | 6.89 GB | Download |
| Fimbulvetr-11B-v2.Q6_K.gguf | GGUF | Q6_K | 8.20 GB | Download |
| Fimbulvetr-11B-v2.fp16.gguf | GGUF | — | 19.99 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"frontmatter": {},
"hero_image_url": "https://huggingface.co/Sao10K/Fimbulvetr-11B-v2/resolve/main/cute1.jpg",
"summary": "GGUF quantization made by Richard Erkhov. Github Discord Request more models Fimbulvetr-11B-v2 - GGUF | Name | Quant method | Size | | ---- | ---- | ---- | | Fimbulvetr-11B-v2.Q2_K.gguf | Q2_K | 3.73GB | | Fimbulvetr-11B-v2.IQ3_XS.gguf | IQ3_XS | 4.14GB | | Fimbulvetr-11B-v2.IQ3_S.gguf | IQ3_S | 4.37GB | | Fimbulvetr-11B-v2.Q3_K_S.gguf | Q3_K_S | 4.34GB | | Fimbulvetr-11B-v2.IQ3_M.gguf | IQ3_M | 4.51GB | | Fimbulvetr-11B-v2.Q3_K.gguf | Q3_K | 4.84GB | | Fimbulvetr-11B-v2.Q3_K_M.gguf | Q3_K_M | 4.84GB | | Fimbulvetr-11B-v2.Q3_K_L.gguf | Q3_K_L | 5.26GB | | Fimbulvetr-11B-v2.IQ4_XS.gguf | IQ4_XS | 5.43GB | | Fimbulvetr-11B-v2.Q4_0.gguf | Q4_0 | 5.66GB | | Fimbulvetr-11B-v2.IQ4_NL.gguf | IQ4_NL | 5.72GB | | Fimbulvetr-11B-v2.Q4_K_S.gguf | Q4_K_S | 5.7GB | | Fimbulvetr-11B-v2.Q4_K.gguf | Q4_K | 6.02GB | | Fimbulvetr-11B-v2.Q4_K_M.gguf | Q4_K_M | 6.02GB | | Fimbulvetr-11B-v2.Q4_1.gguf | Q4_1 | 6.27GB | | Fimbulvetr-11B-v2.Q5_0.gguf | Q5_0 | 6.89GB | | Fimbulvetr-11B-v2.Q5_K_S.gguf | Q5_K_S | 6.89GB | | Fimbulvetr-11B-v2.Q5_K.gguf | Q5_K | 7.08GB | | Fimbulvetr-11B-v2.Q5_K_M.gguf | Q5_K_M | 7.08GB | | Fimbulvetr-11B-v2.Q5_1.gguf | Q5_1 | 7.51GB | | Fimbulvetr-11B-v2.Q6_K.gguf | Q6_K | 8.2GB | Original model description: --- license: cc-by-nc-4.0 language: --- !Fox1 *Cute girl to catch your attention.* **https://huggingface.co/Sao10K/Fimbulvetr-11B-v2-GGUF ### Input: ### Response: ` Vicuna: ` System: User: Assistant: `` **** Changelogs: 25/2 - repo renamed to remove test, model card redone. Model's officially out. 15/2 - Heavy testing complete. Good feedback. *** Rant - Kept For Historical Reasons Ramble to meet minimum length requirements: Tbh i wonder if this shit is even worth doing. Like im just some broke guy lmao I've spent so much. And for what? I guess creds. Feels good when a model gets good feedback, but it seems like im invisible sometimes. I should be probably advertising myself and my models on other places but I rarely have the time to. Probably just internal jealousy sparking up here and now. Wahtever I guess. Anyway cool EMT vocation I'm doing is cool except it pays peanuts, damn bruh 1.1k per month lmao. Government to broke to pay for shit. Pays the bills I suppose. Anyway cool beans, I'm either going to continue the Solar Train or go to Mixtral / Yi when I get paid. You still here?",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "GGUF quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nFimbulvetr-11B-v2 - GGUF\n- Model creator: https://huggingface.co/Sao10K/\n- Original model: https://huggingface.co/Sao10K/Fimbulvetr-11B-v2/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [Fimbulvetr-11B-v2.Q2_K.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q2_K.gguf) | Q2_K | 3.73GB |\n| [Fimbulvetr-11B-v2.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.IQ3_XS.gguf) | IQ3_XS | 4.14GB |\n| [Fimbulvetr-11B-v2.IQ3_S.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.IQ3_S.gguf) | IQ3_S | 4.37GB |\n| [Fimbulvetr-11B-v2.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q3_K_S.gguf) | Q3_K_S | 4.34GB |\n| [Fimbulvetr-11B-v2.IQ3_M.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.IQ3_M.gguf) | IQ3_M | 4.51GB |\n| [Fimbulvetr-11B-v2.Q3_K.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q3_K.gguf) | Q3_K | 4.84GB |\n| [Fimbulvetr-11B-v2.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q3_K_M.gguf) | Q3_K_M | 4.84GB |\n| [Fimbulvetr-11B-v2.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q3_K_L.gguf) | Q3_K_L | 5.26GB |\n| [Fimbulvetr-11B-v2.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.IQ4_XS.gguf) | IQ4_XS | 5.43GB |\n| [Fimbulvetr-11B-v2.Q4_0.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q4_0.gguf) | Q4_0 | 5.66GB |\n| [Fimbulvetr-11B-v2.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.IQ4_NL.gguf) | IQ4_NL | 5.72GB |\n| [Fimbulvetr-11B-v2.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q4_K_S.gguf) | Q4_K_S | 5.7GB |\n| [Fimbulvetr-11B-v2.Q4_K.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q4_K.gguf) | Q4_K | 6.02GB |\n| [Fimbulvetr-11B-v2.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q4_K_M.gguf) | Q4_K_M | 6.02GB |\n| [Fimbulvetr-11B-v2.Q4_1.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q4_1.gguf) | Q4_1 | 6.27GB |\n| [Fimbulvetr-11B-v2.Q5_0.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q5_0.gguf) | Q5_0 | 6.89GB |\n| [Fimbulvetr-11B-v2.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q5_K_S.gguf) | Q5_K_S | 6.89GB |\n| [Fimbulvetr-11B-v2.Q5_K.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q5_K.gguf) | Q5_K | 7.08GB |\n| [Fimbulvetr-11B-v2.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q5_K_M.gguf) | Q5_K_M | 7.08GB |\n| [Fimbulvetr-11B-v2.Q5_1.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q5_1.gguf) | Q5_1 | 7.51GB |\n| [Fimbulvetr-11B-v2.Q6_K.gguf](https://huggingface.co/RichardErkhov/Fimbulvetr-11B-v2-gguf/blob/main/Fimbulvetr-11B-v2.Q6_K.gguf) | Q6_K | 8.2GB |\n\n\n\nOriginal model description:\n---\nlicense: cc-by-nc-4.0\nlanguage:\n- en\n---\n\n\n\n*Cute girl to catch your attention.*\n\n**https://huggingface.co/Sao10K/Fimbulvetr-11B-v2-GGUF <------ GGUF**\n\nFimbulvetr-v2 - A Solar-Based Model\n\nPrompt Formats - Alpaca or Vicuna. Either one works fine.\nRecommended SillyTavern Presets - Universal Light \n\nAlpaca:\n```\n### Instruction:\n<Prompt>\n### Input:\n<Insert Context Here>\n### Response:\n```\n\nVicuna:\n```\nSystem: <Prompt>\n\nUser: <Input>\n\nAssistant:\n```\n\n\n****\n\nChangelogs:\n\n25/2 - repo renamed to remove test, model card redone. Model's officially out.\n<br>15/2 - Heavy testing complete. Good feedback.\n\n***\n\n<details><summary>Rant - Kept For Historical Reasons</summary>\n\nRamble to meet minimum length requirements:\n\nTbh i wonder if this shit is even worth doing. Like im just some broke guy lmao I've spent so much. And for what? I guess creds. Feels good when a model gets good feedback, but it seems like im invisible sometimes. I should be probably advertising myself and my models on other places but I rarely have the time to. Probably just internal jealousy sparking up here and now. Wahtever I guess.\n\nAnyway cool EMT vocation I'm doing is cool except it pays peanuts, damn bruh 1.1k per month lmao. Government to broke to pay for shit. Pays the bills I suppose.\n\nAnyway cool beans, I'm either going to continue the Solar Train or go to Mixtral / Yi when I get paid.\n\nYou still here?\n</details><br>\n\n",
"related_quantizations": []
},
"tags": [
"gguf",
"endpoints_compatible",
"region:us"
],
"likes": 0,
"downloads": 112,
"gated": false,
"private": false,
"last_modified": "2024-04-03T11:44:52.000Z",
"created_at": "2024-04-02T16:48:35.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "660c36e34f66718cc6bf7b8b",
"id": "RichardErkhov/Fimbulvetr-11B-v2-gguf",
"modelId": "RichardErkhov/Fimbulvetr-11B-v2-gguf",
"sha": "31200fc6d12c32e869284c6b3058d6ddcbd3d8d1",
"createdAt": "2024-04-02T16:48:35.000Z",
"lastModified": "2024-04-03T11:44:52.000Z",
"author": "RichardErkhov",
"downloads": 112,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 24
}