bakanayatsu/fimbulvetr-kuro-lotus-10.7b-gguf-imatrix Q5_K_S GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
bakanayatsu/fimbulvetr-kuro-lotus-10.7b-gguf-imatrix overview
Original: Fimbulvetr-Kuro-Lotus-10.7B GGUF: Fimbulvetr-Kuro-Lotus-10.7B-GGUF Imatrix: Here 3/19/2024: Fixed the incoherent generation when context is greater than 4096 with koboldcpp --contextsize
Downloads
86
Likes
5
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
8 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Fimbulvetr-Kuro-Lotus-10.7B-c512-IQ1_S.gguf | GGUF | IQ1_S | 2.19 GB | Download |
| Fimbulvetr-Kuro-Lotus-10.7B-c512-IQ2_XS.gguf | GGUF | IQ2_XS | 3.01 GB | Download |
| Fimbulvetr-Kuro-Lotus-10.7B-c512-IQ3_XS.gguf | GGUF | IQ3_XS | 4.12 GB | Download |
| Fimbulvetr-Kuro-Lotus-10.7B-c512-IQ4_XS.gguf | GGUF | IQ4_XS | 5.38 GB | Download |
| Fimbulvetr-Kuro-Lotus-10.7B-c512-Q4_K_M.gguf | GGUF | Q4_K_M | 6.02 GB | Download |
| Fimbulvetr-Kuro-Lotus-10.7B-c512-Q4_K_S.gguf | GGUF | Q4_K_S | 5.70 GB | Download |
| Fimbulvetr-Kuro-Lotus-10.7B-c512-Q5_K_M.gguf | GGUF | Q5_K_M | 7.08 GB | Download |
| Fimbulvetr-Kuro-Lotus-10.7B-c512-Q5_K_S.gguf | GGUF | Q5_K_S | 6.89 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"frontmatter": {},
"hero_image_url": "",
"summary": "Original: Fimbulvetr-Kuro-Lotus-10.7B GGUF: Fimbulvetr-Kuro-Lotus-10.7B-GGUF Imatrix: Here 3/19/2024: Fixed the incoherent generation when context is greater than 4096 with koboldcpp --contextsize",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "Original: [Fimbulvetr-Kuro-Lotus-10.7B](https://huggingface.co/saishf/Fimbulvetr-Kuro-Lotus-10.7B)\n\nGGUF: [Fimbulvetr-Kuro-Lotus-10.7B-GGUF](https://huggingface.co/saishf/Fimbulvetr-Kuro-Lotus-10.7B-GGUF)\n\nImatrix: Here\n\n3/19/2024: Fixed the incoherent generation when context is greater than 4096 with koboldcpp --contextsize",
"related_quantizations": []
},
"tags": [
"gguf",
"endpoints_compatible",
"region:us"
],
"likes": 5,
"downloads": 86,
"gated": false,
"private": false,
"last_modified": "2024-03-19T18:42:32.000Z",
"created_at": "2024-03-16T10:40:23.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "65f5771743771dd20b7b60fd",
"id": "Bakanayatsu/Fimbulvetr-Kuro-Lotus-10.7B-GGUF-imatrix",
"modelId": "Bakanayatsu/Fimbulvetr-Kuro-Lotus-10.7B-GGUF-imatrix",
"sha": "ea463b4101cb8f67ab48084b00efcfda70468419",
"createdAt": "2024-03-16T10:40:23.000Z",
"lastModified": "2024-03-19T18:42:32.000Z",
"author": "Bakanayatsu",
"downloads": 86,
"likes": 5,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 15
}