casual-autopsy/crec-n-wrec-mate-24b-v2-ggufs Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
casual-autopsy/crec-n-wrec-mate-24b-v2-ggufs overview
CREC-n-WREC-Mate-24B-v2 ### THIS MODEL IS UNOFFICIAL! This model has no official affiliation with Weather and his SillyTavern Extensions. This is simply a fan project to help fellow users of these extensions.
Downloads
84
Likes
2
Pipeline
text-generation
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
22 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| CREC-n-WREC-Mate-24B-v2-bf16.gguf | GGUF | BF16 | 43.92 GB | Download |
| CREC-n-WREC-Mate-24B-v2-iq3_m.gguf | GGUF | IQ3_M | 9.92 GB | Download |
| CREC-n-WREC-Mate-24B-v2-iq3_s.gguf | GGUF | IQ3_S | 9.71 GB | Download |
| CREC-n-WREC-Mate-24B-v2-iq4_nl.gguf | GGUF | IQ4_NL | 12.54 GB | Download |
| CREC-n-WREC-Mate-24B-v2-iq4_xs.gguf | GGUF | IQ4_XS | 11.88 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q3_k_l.gguf | GGUF | Q3_K_L | 11.55 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q3_k_m.gguf | GGUF | Q3_K_M | 10.69 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q3_k_s.gguf | GGUF | Q3_K_S | 9.69 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q3_k_xl.gguf | GGUF | Q3_K_XL | 12.10 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q4_0.gguf | GGUF | — | 12.57 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q4_1.gguf | GGUF | — | 13.85 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q4_k_l.gguf | GGUF | Q4_K_L | 13.81 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q4_k_m.gguf | GGUF | Q4_K_M | 13.35 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q4_k_s.gguf | GGUF | Q4_K_S | 12.62 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q5_0.gguf | GGUF | — | 15.23 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q5_1.gguf | GGUF | — | 16.52 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q5_k_l.gguf | GGUF | Q5_K_L | 16.00 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q5_k_m.gguf | GGUF | Q5_K_M | 15.61 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q5_k_s.gguf | GGUF | Q5_K_S | 15.18 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q6_k.gguf | GGUF | Q6_K | 18.02 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q6_k_l.gguf | GGUF | Q6_K_L | 18.32 GB | Download |
| CREC-n-WREC-Mate-24B-v2-q8_0.gguf | GGUF | — | 23.33 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"base_model": [
"Casual-Autopsy/CREC-n-WREC-Mate-24B-v2"
],
"pipeline_tag": "text-generation",
"tags": [
"imatrix_gguf",
"static_gguf",
"sillytavern",
"character_creation",
"wi_creation",
"not-for-all-audiences"
],
"frontmatter": {
"base_model": [
"Casual-Autopsy/CREC-n-WREC-Mate-24B-v2"
],
"pipeline_tag": "text-generation",
"tags": [
"imatrix_gguf",
"static_gguf",
"sillytavern",
"character_creation",
"wi_creation",
"not-for-all-audiences"
]
},
"hero_image_url": "",
"summary": "# CREC-n-WREC-Mate-24B-v2 ### THIS MODEL IS UNOFFICIAL! This model has no official affiliation with Weather and his SillyTavern Extensions. This is simply a fan project to help fellow users of these extensions.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nbase_model:\n- Casual-Autopsy/CREC-n-WREC-Mate-24B-v2\npipeline_tag: text-generation\ntags:\n- imatrix_gguf\n- static_gguf\n- sillytavern\n- character_creation\n- wi_creation\n- not-for-all-audiences\n---\n# CREC-n-WREC-Mate-24B-v2\n### THIS MODEL IS UNOFFICIAL!\n\nThis model has no official affiliation with Weather and his SillyTavern Extensions. This is simply a fan project to help fellow users of these extensions.\n\n## Merge Description\n\nCREC-n-WREC-Mate is a model made to help create World Info entries mid-roleplay using the SillyTavern extensions [CREC](https://github.com/bmen25124/SillyTavern-Character-Creator) and [WREC](https://github.com/bmen25124/SillyTavern-WorldInfo-Recommender/).\n\nThe responses a bit on the shorter side by default, but this should be all the more beneficial for creating World Info entries. Needless to say, this isn't a model designed for creating Char Cards, instead it's meant for saving characters you encounter on your adventures to a Lorebook, so make sure to enable the feature that allows adding characters to a WI entry in the CREC settings menu.\n\n**WREC Setup:** [here](https://huggingface.co/Casual-Autopsy/CREC-n-WREC-Mate-24B-v2/blob/main/README_WREC-Setup.md)\n\n**CREC Setup:** [here](https://huggingface.co/Casual-Autopsy/CREC-n-WREC-Mate-24B-v2/blob/main/README_CREC-Setup.md)\n\n## Merge Details\nThis is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).\n\n### Merge Method\n\nThis model was merged using the [Conflict-Aware N:M Sparsification](https://arxiv.org/abs/2503.01874) merge method using [TheDrummer/Cydonia-24B-v2.1](https://huggingface.co/TheDrummer/Cydonia-24B-v2.1) as a base.\n\n### Models Merged\n\nThe following models were included in the merge:\n* [CharGen-Archive/CharGen-v3-beta-275-s0](https://huggingface.co/CharGen-Archive/CharGen-v3-beta-275-s0)\n* [SlerpE/CardProjector-24B-v3](https://huggingface.co/SlerpE/CardProjector-24B-v3)\n* [Mawdistical/Mawdistic-NightLife-24b](https://huggingface.co/Mawdistical/Mawdistic-NightLife-24b)\n* [ReadyArt/Broken-Tutu-24B](https://huggingface.co/ReadyArt/Broken-Tutu-24B)\n\n### Configuration\n\nThe following YAML configurations were used to produce this model:\n\n#### C-n-W-CharGen_v2\n```yaml\nmodels:\n - model: CharGen-Archive/CharGen-v3-beta-275-s0\n - model: Mawdistical/Mawdistic-NightLife-24b\n parameters:\n weight: 0.3\n n_val: 64\n m_val: 128\n - model: SlerpE/CardProjector-24B-v3\n parameters:\n weight: 0.2\n n_val: 16\n m_val: 32\nmerge_method: cabs\npruning_order:\n - Mawdistical/Mawdistic-NightLife-24b\n - SlerpE/CardProjector-24B-v3\nbase_model: CharGen-Archive/CharGen-v3-beta-275-s0\ndtype: float32\ntokenizer:\n source: union\n tokens:\n </s>:\n source:\n kind: model_token\n model: CharGen-Archive/CharGen-v3-beta-275-s0\n token: \"<|im_end|>\"\n \"[INST]\":\n source:\n kind: model_token\n model: CharGen-Archive/CharGen-v3-beta-275-s0\n token: \"<|im_start|>\"\n```\n\n#### C-n-W-CardProj_v2\n```yaml\nmodels:\n - model: SlerpE/CardProjector-24B-v3\n - model: ReadyArt/Broken-Tutu-24B\n parameters:\n weight: 0.3\n n_val: 64\n m_val: 128\n - model: CharGen-Archive/CharGen-v3-beta-275-s0\n parameters:\n weight: 0.2\n n_val: 16\n m_val: 32\nmerge_method: cabs\npruning_order:\n - ReadyArt/Broken-Tutu-24B\n - CharGen-Archive/CharGen-v3-beta-275-s0\nbase_model: SlerpE/CardProjector-24B-v3\ndtype: float32\ntokenizer:\n source: union\n tokens:\n \"[/INST]\":\n source:\n kind: model_token\n model: CharGen-Archive/CharGen-v3-beta-275-s0\n token: \"<|im_end|>\"\n source:\n kind: model_token\n model: CharGen-Archive/CharGen-v3-beta-275-s0\n token: \"<|im_start|>\"\n```\n\n#### CREC-n-WREC-Mate-24B-v2\n```yaml\nmodels:\n - model: TheDrummer/Cydonia-24B-v2.1\n - model: C-n-W-CardProj_v2\n parameters:\n weight: 0.6\n n_val: 64\n m_val: 128\n - model: C-n-W-CharGen_v2\n parameters:\n weight: 0.4\n n_val: 12\n m_val: 32\nmerge_method: cabs\npruning_order:\n - C-n-W-CardProj_v2\n - C-n-W-CharGen_v2\nbase_model: TheDrummer/Cydonia-24B-v2.1\ndtype: float32\nout_dtype: bfloat16\ntokenizer:\n source: union\n tokens:\n \"[/INST]\":\n source:\n kind: model_token\n model: C-n-W-CardProj_v2\n token: \"[/INST]\"\n source:\n kind: model_token\n model: C-n-W-CharGen_v2\n token: \"[/INST]\"\n \"[INST]\":\n source:\n kind: model_token\n model: C-n-W-CardProj_v2\n token: \"[INST]\"\n source:\n kind: model_token\n model: C-n-W-CharGen_v2\n token: \"[INST]\"\n </s>:\n source:\n kind: model_token\n model: C-n-W-CardProj_v2\n token: \"</s>\"\n source:\n kind: model_token\n model: C-n-W-CharGen_v2\n token: \"</s>\"\n```",
"related_quantizations": []
},
"tags": [
"gguf",
"imatrix_gguf",
"static_gguf",
"sillytavern",
"character_creation",
"wi_creation",
"not-for-all-audiences",
"text-generation",
"arxiv:2503.01874",
"base_model:Casual-Autopsy/CREC-n-WREC-Mate-24B-v2",
"base_model:quantized:Casual-Autopsy/CREC-n-WREC-Mate-24B-v2",
"endpoints_compatible",
"region:us"
],
"likes": 2,
"downloads": 84,
"gated": false,
"private": false,
"last_modified": "2025-08-14T13:19:30.000Z",
"created_at": "2025-08-11T17:09:27.000Z",
"pipeline_tag": "text-generation",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "689a23c7fced0b783f184420",
"id": "Casual-Autopsy/CREC-n-WREC-Mate-24B-v2-GGUFs",
"modelId": "Casual-Autopsy/CREC-n-WREC-Mate-24B-v2-GGUFs",
"sha": "c0fdc137cdb372c15e112a22479bc4504ef83c70",
"createdAt": "2025-08-11T17:09:27.000Z",
"lastModified": "2025-08-14T13:19:30.000Z",
"author": "Casual-Autopsy",
"downloads": 84,
"likes": 2,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "",
"siblings_count": 25
}