GraySoft
Projects Models About FAQ Contact Download guIDE →

lewdiculous/llama-3.1-8b-arliai-rpmax-v1.2-gguf-iq-arm-imatrix F16 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

lewdiculous/llama-3.1-8b-arliai-rpmax-v1.2-gguf-iq-arm-imatrix overview

My GGUF-IQ-ARM-Imatrix quants for ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2. "RPMax is a series of models that are trained on a diverse set of curated creative writing and RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive by making sure no two entries in the dataset have repeated characters or situations, which makes sure the model does not latch on to a certain personality and be capable of understanding and acting appropriately to any characters or situations. Early tests by users mentioned that these models does not feel like any other RP models..." Use the Llama 3 Instruct prompt format.

ggufroleplayrpsillytavernllamaenbase_model:ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2base_model:quantized:ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2license:unlicenseregion:usimatrixconversational
lewdiculous/llama-3.1-8b-arliai-rpmax-v1.2-gguf-iq-arm-imatrix visual
Downloads
526
Likes
12
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

16 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
ARM-Llama-3.1-8B-ArliAI-RPMax-v1.2-Q4_0_4_4-imat.gguf GGUF 4.34 GB Download
ARM-Llama-3.1-8B-ArliAI-RPMax-v1.2-Q4_0_4_8-imat.gguf GGUF 4.34 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-BF16.gguf GGUF BF16 14.97 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-F16.gguf GGUF F16 14.97 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-IQ3_M-imat.gguf GGUF IQ3_M 3.52 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-IQ3_S-imat.gguf GGUF IQ3_S 3.43 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-IQ3_XS-imat.gguf GGUF IQ3_XS 3.28 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-IQ3_XXS-imat.gguf GGUF IQ3_XXS 3.05 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-IQ4_XS-imat.gguf GGUF IQ4_XS 4.14 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-Q3_K_L-imat.gguf GGUF Q3_K_L 4.03 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-Q3_K_M-imat.gguf GGUF Q3_K_M 3.74 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-Q4_K_M-imat.gguf GGUF Q4_K_M 4.58 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-Q4_K_S-imat.gguf GGUF Q4_K_S 4.37 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-Q5_K_S-imat.gguf GGUF Q5_K_S 5.21 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-Q6_K-imat.gguf GGUF Q6_K 6.14 GB Download
Llama-3.1-8B-ArliAI-RPMax-v1.2-Q8_0-imat.gguf GGUF 7.95 GB Download

Model Details Live

Model Slug
lewdiculous/llama-3.1-8b-arliai-rpmax-v1.2-gguf-iq-arm-imatrix
Author
Lewdiculous
Pipeline Task
Library
Created
2024-10-24
Last Modified
2024-10-24
Gated
No
Private
No
HF SHA
9416c2d40129d3c4470df562cddef6ee82fe18aa
License
unlicense
Language
en
Base Model
ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "unlicense",
    "language": [
      "en"
    ],
    "base_model": [
      "ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2"
    ],
    "tags": [
      "roleplay",
      "rp",
      "sillytavern",
      "gguf",
      "llama"
    ],
    "inference": false,
    "frontmatter": {
      "license": "unlicense",
      "language": [
        "en"
      ],
      "base_model": [
        "ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2"
      ],
      "tags": [
        "roleplay",
        "rp",
        "sillytavern",
        "gguf",
        "llama"
      ],
      "inference": "false"
    },
    "hero_image_url": "https://iili.io/2f5bgWb.png",
    "summary": "My GGUF-IQ-ARM-Imatrix quants for **ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2**. \"RPMax is a series of models that are trained on a diverse set of curated creative writing and RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive by making sure no two entries in the dataset have repeated characters or situations, which makes sure the model does not latch on to a certain personality and be capable of understanding and acting appropriately to any characters or situations. Early tests by users mentioned that these models does not feel like any other RP models...\" > [!NOTE] > Use the **Llama 3 Instruct** prompt format.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: unlicense\nlanguage:\n- en\nbase_model:\n- ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2\ntags:\n- roleplay\n- rp\n- sillytavern\n- gguf\n- llama\ninference: false\n---\n\nMy GGUF-IQ-ARM-Imatrix quants for [**ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2**](https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2).\n\n\"RPMax is a series of models that are trained on a diverse set of curated creative writing and RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive by making sure no two entries in the dataset have repeated characters or situations, which makes sure the model does not latch on to a certain personality and be capable of understanding and acting appropriately to any characters or situations. Early tests by users mentioned that these models does not feel like any other RP models...\"\n\n> [!NOTE]\n> Use the **Llama 3 Instruct** prompt format.\n\n<img src=\"https://iili.io/2f5bgWb.png\" alt=\"anime-girl-model-card\">",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "roleplay",
    "rp",
    "sillytavern",
    "llama",
    "en",
    "base_model:ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2",
    "base_model:quantized:ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.2",
    "license:unlicense",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 12,
  "downloads": 526,
  "gated": false,
  "private": false,
  "last_modified": "2024-10-24T17:20:25.000Z",
  "created_at": "2024-10-24T15:38:11.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "671a69e3813e62cf4a0ac6c0",
  "id": "Lewdiculous/Llama-3.1-8B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix",
  "modelId": "Lewdiculous/Llama-3.1-8B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix",
  "sha": "9416c2d40129d3c4470df562cddef6ee82fe18aa",
  "createdAt": "2024-10-24T15:38:11.000Z",
  "lastModified": "2024-10-24T17:20:25.000Z",
  "author": "Lewdiculous",
  "downloads": 526,
  "likes": 12,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 21
}