joseph717171/deephermes-3-mistral-24b-preview-oq8_0-f32.eq8_0-f32.iq4_k-q8_0-gguf IQ5_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
joseph717171/deephermes-3-mistral-24b-preview-oq8_0-f32.eq8_0-f32.iq4_k-q8_0-gguf overview
Custom GGUF quants of NousResearch/DeepHermes-3-Mistral-24B-Preview, where the Output Tensors are kept at F32 or quantized to Q80, and the Embeddings are kept at F32 or Quantized to Q80. Enjoy! 🧠🔥🚀
Downloads
180
Likes
1
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
15 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| DeepHermes-3-Mistral-24B-Preview-OF32.EF32.IQ4_K_M.gguf | GGUF | F32 | 17.49 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OF32.EF32.IQ5_K_M.gguf | GGUF | F32 | 19.67 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OF32.EF32.IQ5_K_S.gguf | GGUF | F32 | 19.24 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OF32.EF32.IQ6_K.gguf | GGUF | F32 | 21.99 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OF32.EF32.IQ8_0.gguf | GGUF | F32 | 27.01 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EF32.IQ4_K_M.gguf | GGUF | F32 | 15.65 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EF32.IQ5_K_M.gguf | GGUF | F32 | 17.83 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EF32.IQ5_K_S.gguf | GGUF | F32 | 17.41 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EF32.IQ6_K.gguf | GGUF | F32 | 20.16 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EF32.IQ8_0.gguf | GGUF | F32 | 25.17 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EQ8_0.IQ4_K_M.gguf | GGUF | IQ4_K_M | 13.81 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EQ8_0.IQ5_K_M.gguf | GGUF | IQ5_K_M | 16.00 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EQ8_0.IQ5_K_S.gguf | GGUF | IQ5_K_S | 15.57 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EQ8_0.IQ6_K.gguf | GGUF | IQ6_K | 18.32 GB | Download |
| DeepHermes-3-Mistral-24B-Preview-OQ8_0.EQ8_0.IQ8_0.gguf | GGUF | — | 23.33 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"frontmatter": {},
"hero_image_url": "",
"summary": "Custom GGUF quants of NousResearch/DeepHermes-3-Mistral-24B-Preview, where the Output Tensors are kept at F32 or quantized to Q8_0, and the Embeddings are kept at F32 or Quantized to Q8_0. Enjoy! 🧠🔥🚀",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "Custom GGUF quants of [NousResearch/DeepHermes-3-Mistral-24B-Preview](https://huggingface.co/NousResearch/DeepHermes-3-Mistral-24B-Preview), where the Output Tensors are kept at F32 or quantized to Q8_0, and the Embeddings are kept at F32 or Quantized to Q8_0. Enjoy! 🧠🔥🚀",
"related_quantizations": []
},
"tags": [
"gguf",
"endpoints_compatible",
"region:us",
"imatrix",
"conversational"
],
"likes": 1,
"downloads": 180,
"gated": false,
"private": false,
"last_modified": "2025-03-14T05:47:39.000Z",
"created_at": "2025-03-14T02:14:21.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "67d390fd9546ac740702eceb",
"id": "Joseph717171/DeepHermes-3-Mistral-24B-Preview-OQ8_0-F32.EQ8_0-F32.IQ4_K-Q8_0-GGUF",
"modelId": "Joseph717171/DeepHermes-3-Mistral-24B-Preview-OQ8_0-F32.EQ8_0-F32.IQ4_K-Q8_0-GGUF",
"sha": "4a5d642554cf63a6a026ccb32e2222076e141347",
"createdAt": "2025-03-14T02:14:21.000Z",
"lastModified": "2025-03-14T05:47:39.000Z",
"author": "Joseph717171",
"downloads": 180,
"likes": 1,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 18
}