lewdiculous/eris_primev4.69-vision-32k-7b-gguf-imatrix IQ4_XS GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
lewdiculous/eris_primev4.69-vision-32k-7b-gguf-imatrix overview
If you want to use vision functionality: You must use the latest version of KoboldCpp. To use the multimodal capabilities of this model and use vision you need to load the specified mmproj file, this can be found inside this model repo. You can load the mmproj by using the corresponding section in the interface: !image/png
Downloads
96
Likes
6
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
9 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Eris_PrimeV4.69-Vision-32k-7B-F16.gguf | GGUF | F16 | 13.49 GB | Download |
| Eris_PrimeV4.69-Vision-32k-7B-IQ4_XS-imat.gguf | GGUF | IQ4_XS | 3.64 GB | Download |
| Eris_PrimeV4.69-Vision-32k-7B-Q4_K_M-imat.gguf | GGUF | Q4_K_M | 4.07 GB | Download |
| Eris_PrimeV4.69-Vision-32k-7B-Q4_K_S-imat.gguf | GGUF | Q4_K_S | 3.86 GB | Download |
| Eris_PrimeV4.69-Vision-32k-7B-Q5_K_M-imat.gguf | GGUF | Q5_K_M | 4.78 GB | Download |
| Eris_PrimeV4.69-Vision-32k-7B-Q5_K_S-imat.gguf | GGUF | Q5_K_S | 4.65 GB | Download |
| Eris_PrimeV4.69-Vision-32k-7B-Q6_K-imat.gguf | GGUF | Q6_K | 5.53 GB | Download |
| Eris_PrimeV4.69-Vision-32k-7B-Q8_0-imat.gguf | GGUF | — | 7.17 GB | Download |
| mmproj-model-f16.gguf | GGUF | F16 | 595.52 MB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"tags": [
"experimental",
"testing",
"gguf",
"roleplay",
"multimodal",
"vision",
"llava"
],
"frontmatter": {
"tags": [
"experimental",
"testing",
"gguf",
"roleplay",
"multimodal",
"vision",
"llava"
]
},
"hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/ZKTLoWLodd7ixVaU4xZbq.png",
"summary": "If you want to use vision functionality: * You must use the latest version of KoboldCpp. To use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo. * You can load the **mmproj** by using the corresponding section in the interface: !image/png",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\ntags:\n- experimental\n- testing\n- gguf\n- roleplay\n- multimodal\n- vision\n- llava\n---\n# #Roleplay #Multimodal #Vision\n\n**These are quants for an experimental model.**\n\n quantization_options = [\n \"Q4_K_M\", \"Q4_K_S\", \"IQ4_XS\",\n \"Q5_K_M\", \"Q5_K_S\",\n \"Q6_K\", \"Q8_0\"\n ]\n\nOriginal model weights and information: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4.69-Vision-32k-7B\n\nMMPROJ: <br> [./mmproj/mmproj-model-f16.gguf](./mmproj/mmproj-model-f16.gguf)\n\n\n\n# Vision/multimodal capabilities:\n\n If you want to use vision functionality:\n\n * You must use the latest version of [KoboldCpp](https://github.com/LostRuins/koboldcpp).\n \nTo use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo.\n \n * You can load the **mmproj** by using the corresponding section in the interface:\n\n \n",
"related_quantizations": []
},
"tags": [
"gguf",
"experimental",
"testing",
"roleplay",
"multimodal",
"vision",
"llava",
"endpoints_compatible",
"region:us"
],
"likes": 6,
"downloads": 96,
"gated": false,
"private": false,
"last_modified": "2024-03-29T13:01:36.000Z",
"created_at": "2024-03-29T11:11:21.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "6606a1d9d3168662c6417814",
"id": "Lewdiculous/Eris_PrimeV4.69-Vision-32k-7B-GGUF-Imatrix",
"modelId": "Lewdiculous/Eris_PrimeV4.69-Vision-32k-7B-GGUF-Imatrix",
"sha": "9afddca412eb25421cd6fb29725a62ee31ca5a25",
"createdAt": "2024-03-29T11:11:21.000Z",
"lastModified": "2024-03-29T13:01:36.000Z",
"author": "Lewdiculous",
"downloads": 96,
"likes": 6,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 13
}