GraySoft
Projects Models About FAQ Contact Download guIDE →

lewdiculous/mistral-nemo-12b-arliai-rpmax-v1.2-gguf-iq-arm-imatrix Q6_K GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

lewdiculous/mistral-nemo-12b-arliai-rpmax-v1.2-gguf-iq-arm-imatrix overview

My quants for ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2. "RPMax is a series of models that are trained on a diverse set of curated creative writing and RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive by making sure no two entries in the dataset have repeated characters or situations, which makes sure the model does not latch on to a certain personality and be capable of understanding and acting appropriately to any characters or situations. Early tests by users mentioned that these models does not feel like any other RP models..." Mistral Instruct prompt format. !image/png

ggufroleplayrpsillytavernenbase_model:ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2base_model:quantized:ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2license:unlicenseregion:usimatrixconversational
lewdiculous/mistral-nemo-12b-arliai-rpmax-v1.2-gguf-iq-arm-imatrix visual
Downloads
516
Likes
12
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

17 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
ARM-Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q4_0_4_4-imat.gguf GGUF 6.59 GB Download
ARM-Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q4_0_4_8-imat.gguf GGUF 6.59 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-BF16.gguf GGUF BF16 22.82 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-F16.gguf GGUF F16 22.82 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-IQ3_M-imat.gguf GGUF IQ3_M 5.33 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-IQ3_S-imat.gguf GGUF IQ3_S 5.18 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-IQ3_XS-imat.gguf GGUF IQ3_XS 4.94 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-IQ3_XXS-imat.gguf GGUF IQ3_XXS 4.61 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-IQ4_XS-imat.gguf GGUF IQ4_XS 6.28 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q3_K_L-imat.gguf GGUF Q3_K_L 6.11 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q3_K_M-imat.gguf GGUF Q3_K_M 5.67 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q4_K_M-imat.gguf GGUF Q4_K_M 6.96 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q4_K_S-imat.gguf GGUF Q4_K_S 6.63 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q5_K_M-imat.gguf GGUF Q5_K_M 8.13 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q5_K_S-imat.gguf GGUF Q5_K_S 7.93 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q6_K-imat.gguf GGUF Q6_K 9.37 GB Download
Mistral-Nemo-12B-ArliAI-RPMax-v1.2-Q8_0-imat.gguf GGUF 12.13 GB Download

Model Details Live

Model Slug
lewdiculous/mistral-nemo-12b-arliai-rpmax-v1.2-gguf-iq-arm-imatrix
Author
Lewdiculous
Pipeline Task
Library
Created
2024-10-22
Last Modified
2024-12-18
Gated
No
Private
No
HF SHA
97cddd15eff56a53b2e774d4c582e4e27de3c24e
License
unlicense
Language
en
Base Model
ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "unlicense",
    "language": [
      "en"
    ],
    "base_model": [
      "ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2"
    ],
    "tags": [
      "roleplay",
      "rp",
      "sillytavern",
      "gguf"
    ],
    "inference": false,
    "frontmatter": {
      "license": "unlicense",
      "language": [
        "en"
      ],
      "base_model": [
        "ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2"
      ],
      "tags": [
        "roleplay",
        "rp",
        "sillytavern",
        "gguf"
      ],
      "inference": "false"
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/SY-b6f7mlAd-d3TLYoOrT.png",
    "summary": "My quants for **ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2**. \"RPMax is a series of models that are trained on a diverse set of curated creative writing and RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive by making sure no two entries in the dataset have repeated characters or situations, which makes sure the model does not latch on to a certain personality and be capable of understanding and acting appropriately to any characters or situations. Early tests by users mentioned that these models does not feel like any other RP models...\" > [!NOTE] > **Mistral Instruct** prompt format. !image/png",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: unlicense\nlanguage:\n- en\nbase_model:\n- ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2\ntags:\n- roleplay\n- rp\n- sillytavern\n- gguf\ninference: false\n---\n\nMy quants for [**ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2**](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2).\n\n\"RPMax is a series of models that are trained on a diverse set of curated creative writing and RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive by making sure no two entries in the dataset have repeated characters or situations, which makes sure the model does not latch on to a certain personality and be capable of understanding and acting appropriately to any characters or situations. Early tests by users mentioned that these models does not feel like any other RP models...\"\n\n> [!NOTE]\n> **Mistral Instruct** prompt format.\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/SY-b6f7mlAd-d3TLYoOrT.png)\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "roleplay",
    "rp",
    "sillytavern",
    "en",
    "base_model:ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2",
    "base_model:quantized:ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2",
    "license:unlicense",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 12,
  "downloads": 516,
  "gated": false,
  "private": false,
  "last_modified": "2024-12-18T02:47:10.000Z",
  "created_at": "2024-10-22T11:15:51.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "671789674f05a07705c267fe",
  "id": "Lewdiculous/Mistral-Nemo-12B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix",
  "modelId": "Lewdiculous/Mistral-Nemo-12B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix",
  "sha": "97cddd15eff56a53b2e774d4c582e4e27de3c24e",
  "createdAt": "2024-10-22T11:15:51.000Z",
  "lastModified": "2024-12-18T02:47:10.000Z",
  "author": "Lewdiculous",
  "downloads": 516,
  "likes": 12,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 21
}