GraySoft
Projects Models About FAQ Contact Download guIDE →

lewdiculous/llama-3.1-8b-arliai-formax-v1.0-gguf-iq-arm-imatrix IQ4_XS GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

lewdiculous/llama-3.1-8b-arliai-formax-v1.0-gguf-iq-arm-imatrix overview

My quants for ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0. "Formax is a model that specializes in following response format instructions. Tell it the format of it's response and it will follow it perfectly. Great for data processing and dataset creation tasks." "It is also a highly uncensored model that will follow your instructions very well." ChatML prompt format. 2HmlLn2.md.png

ggufroleplayrpsillytavernenbase_model:ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0base_model:quantized:ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0license:unlicenseendpoints_compatibleregion:usimatrixconversational
lewdiculous/llama-3.1-8b-arliai-formax-v1.0-gguf-iq-arm-imatrix visual
Downloads
525
Likes
4
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

13 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_4_4-imat.gguf GGUF 4.34 GB Download
ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_4_8-imat.gguf GGUF 4.34 GB Download
ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_8_8-imat.gguf GGUF 4.34 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-BF16.gguf GGUF BF16 14.97 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-F16.gguf GGUF F16 14.97 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-IQ3_XXS-imat.gguf GGUF IQ3_XXS 3.05 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-IQ4_XS-imat.gguf GGUF IQ4_XS 4.14 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf GGUF Q4_K_M 4.58 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_S-imat.gguf GGUF Q4_K_S 4.37 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-Q5_K_M-imat.gguf GGUF Q5_K_M 5.34 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-Q5_K_S-imat.gguf GGUF Q5_K_S 5.21 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-Q6_K-imat.gguf GGUF Q6_K 6.14 GB Download
Llama-3.1-8B-ArliAI-Formax-v1.0-Q8_0-imat.gguf GGUF 7.95 GB Download

Model Details Live

Model Slug
lewdiculous/llama-3.1-8b-arliai-formax-v1.0-gguf-iq-arm-imatrix
Author
Lewdiculous
Pipeline Task
Library
Created
2024-10-12
Last Modified
2024-10-14
Gated
No
Private
No
HF SHA
e1446c9f588d6a0cbab38f4aaf3c4c71a28a5bc8
License
unlicense
Language
en
Base Model
ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "unlicense",
    "language": [
      "en"
    ],
    "base_model": [
      "ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0"
    ],
    "tags": [
      "roleplay",
      "rp",
      "sillytavern"
    ],
    "frontmatter": {
      "license": "unlicense",
      "language": [
        "en"
      ],
      "base_model": [
        "ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0"
      ],
      "tags": [
        "roleplay",
        "rp",
        "sillytavern"
      ]
    },
    "hero_image_url": "https://iili.io/2HmlLn2.md.png",
    "summary": "My quants for **ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0**. \"Formax is a model that specializes in following response format instructions. Tell it the format of it's response and it will follow it perfectly. Great for data processing and dataset creation tasks.\" \"It is also a highly uncensored model that will follow your instructions very well.\" > [!NOTE] > **ChatML** prompt format. ![2HmlLn2.md.png](https://freeimage.host/i/2HmlLn2)",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: unlicense\nlanguage:\n- en\nbase_model:\n- ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0\ntags:\n- roleplay\n- rp\n- sillytavern\n---\n\nMy quants for **ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0**.\n\n\"Formax is a model that specializes in following response format instructions. Tell it the format of it's response and it will follow it perfectly. Great for data processing and dataset creation tasks.\"\n\n\"It is also a highly uncensored model that will follow your instructions very well.\"\n\n> [!NOTE]\n> **ChatML** prompt format.\n\n[![2HmlLn2.md.png](https://iili.io/2HmlLn2.md.png)](https://freeimage.host/i/2HmlLn2)",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "roleplay",
    "rp",
    "sillytavern",
    "en",
    "base_model:ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0",
    "base_model:quantized:ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0",
    "license:unlicense",
    "endpoints_compatible",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 4,
  "downloads": 525,
  "gated": false,
  "private": false,
  "last_modified": "2024-10-14T15:49:34.000Z",
  "created_at": "2024-10-12T13:42:00.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "670a7ca853dcd91dc5b3e7c7",
  "id": "Lewdiculous/Llama-3.1-8B-ArliAI-Formax-v1.0-GGUF-IQ-ARM-Imatrix",
  "modelId": "Lewdiculous/Llama-3.1-8B-ArliAI-Formax-v1.0-GGUF-IQ-ARM-Imatrix",
  "sha": "e1446c9f588d6a0cbab38f4aaf3c4c71a28a5bc8",
  "createdAt": "2024-10-12T13:42:00.000Z",
  "lastModified": "2024-10-14T15:49:34.000Z",
  "author": "Lewdiculous",
  "downloads": 525,
  "likes": 4,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 17
}