GraySoft
Download guIDE →
Projects Models About FAQ Contact Download guIDE →

lewdiculous/ds-r1-qwen3-8b-arliai-rpr-v4-small-gguf-iq-imatrix Q5_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

lewdiculous/ds-r1-qwen3-8b-arliai-rpr-v4-small-gguf-iq-imatrix overview

!reasoning-settings

ggufqwen3qwenchatmlsillytavernroleplayconversationalreasoningthinkingenbase_model:ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Smallbase_model:quantized:ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Smalllicense:apache-2.0endpoints_compatibleregion:usimatrix
lewdiculous/ds-r1-qwen3-8b-arliai-rpr-v4-small-gguf-iq-imatrix visual
Downloads
1,860
Likes
16
Pipeline
—
Library
—
Visibility
Public
Access
Open

Repository Files & Downloads

16 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
ARM-DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q4_0-imat.gguf GGUF — 4.46 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-BF16.gguf GGUF BF16 15.26 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-F16.gguf GGUF F16 15.26 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-IQ3_M-imat.gguf GGUF IQ3_M 3.63 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-IQ3_S-imat.gguf GGUF IQ3_S 3.53 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-IQ3_XS-imat.gguf GGUF IQ3_XS 3.38 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-IQ3_XXS-imat.gguf GGUF IQ3_XXS 3.14 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-IQ4_XS-imat.gguf GGUF IQ4_XS 4.25 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q3_K_L-imat.gguf GGUF Q3_K_L 4.13 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q3_K_M-imat.gguf GGUF Q3_K_M 3.84 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q4_K_M-imat.gguf GGUF Q4_K_M 4.68 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q4_K_S-imat.gguf GGUF Q4_K_S 4.47 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q5_K_M-imat.gguf GGUF Q5_K_M 5.45 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q5_K_S-imat.gguf GGUF Q5_K_S 5.33 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q6_K-imat.gguf GGUF Q6_K 6.26 GB Download
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q8_0-imat.gguf GGUF — 8.11 GB Download

Model Details Live

Model Slug
lewdiculous/ds-r1-qwen3-8b-arliai-rpr-v4-small-gguf-iq-imatrix
Author
Lewdiculous
Pipeline Task
—
Library
—
Created
2025-06-08
Last Modified
2025-06-08
Gated
No
Private
No
HF SHA
fbc18423039c293e3bac21438371f49e78309357
License
apache-2.0
Language
en
Base Model
ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small

Metadata Inspector

Normalized metadata (stored in metadata_json) 
{
  "metadata": {},
  "card_data": {
    "language": [
      "en"
    ],
    "base_model": [
      "ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small"
    ],
    "tags": [
      "qwen3",
      "qwen",
      "chatml",
      "sillytavern",
      "roleplay",
      "conversational",
      "reasoning",
      "thinking"
    ],
    "license": "apache-2.0",
    "frontmatter": {
      "language": [
        "en"
      ],
      "base_model": [
        "ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small"
      ],
      "tags": [
        "qwen3",
        "qwen",
        "chatml",
        "sillytavern",
        "roleplay",
        "conversational",
        "reasoning",
        "thinking"
      ],
      "license": "apache-2.0"
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/K4al_bzXJAQkefaEN3IYN.jpeg",
    "summary": "!reasoning-settings",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlanguage:\n- en\nbase_model:\n- ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small\ntags:\n- qwen3\n- qwen\n- chatml\n- sillytavern\n- roleplay\n- conversational\n- reasoning\n- thinking\nlicense: apache-2.0\n---\n\n<!--\n- presets\n- mistral\n-->\n\n<!--\n> [!WARNING]\n> **Uploading...** <br>\n> Card will be updated later.\n-->\n\nMy **GGUF-Imatrix** quants of [**DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small**](https://huggingface.co/ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small). <br>\n\n![model-mascot](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/K4al_bzXJAQkefaEN3IYN.jpeg)\n\n> [!NOTE]\n> **Prompt format:** <br>\n> ChatML\n>\n> **Note:** <br>\n> Set the additional settings as per the instructions in the image at the end of the card to use the thinking setup. [[1]](https://files.catbox.moe/3jky2q.jpg) <br>\n> ![example 1](https://files.catbox.moe/fteelh.jpg)\n\n# Reasoning setup in SillyTavern:\n\n![reasoning-settings](https://files.catbox.moe/3jky2q.jpg)\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "qwen3",
    "qwen",
    "chatml",
    "sillytavern",
    "roleplay",
    "conversational",
    "reasoning",
    "thinking",
    "en",
    "base_model:ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small",
    "base_model:quantized:ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "imatrix"
  ],
  "likes": 16,
  "downloads": 1860,
  "gated": false,
  "private": false,
  "last_modified": "2025-06-08T04:21:42.000Z",
  "created_at": "2025-06-08T02:20:08.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API) 
{
  "_id": "6844f35814c7a1b16f5f63c1",
  "id": "Lewdiculous/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-GGUF-IQ-Imatrix",
  "modelId": "Lewdiculous/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-GGUF-IQ-Imatrix",
  "sha": "fbc18423039c293e3bac21438371f49e78309357",
  "createdAt": "2025-06-08T02:20:08.000Z",
  "lastModified": "2025-06-08T04:21:42.000Z",
  "author": "Lewdiculous",
  "downloads": 1860,
  "likes": 16,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 21
}

More models in this shard