GraySoft
Projects Models About FAQ Contact Download guIDE →

lm-kit/llama-3.2-3b-instruct.gguf - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

lm-kit/llama-3.2-3b-instruct.gguf overview

Model Summary This repository hosts quantized versions of the Llama-3.2-3B-Instruct model. Format: GGUF Converter: llama.cpp 70392f1f81470607ba3afef04aa56c9f65587664 Quantizer: LM-Kit.NET 2024.8.4 For more detailed information on the base model, please visit the following link

gguflicense:llama3.2endpoints_compatibleregion:usconversational
lm-kit/llama-3.2-3b-instruct.gguf visual
Downloads
102
Likes
0
Pipeline
—
Library
—
Visibility
Public
Access
Open

Repository Files & Downloads

11 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Llama-3.2-3B-Instruct-F16.gguf GGUF F16 5.99 GB Download
Llama-3.2-3B-Instruct-Q2_K.gguf GGUF Q2_K 1.27 GB Download
Llama-3.2-3B-Instruct-Q3_K_L.gguf GGUF Q3_K_L 1.69 GB Download
Llama-3.2-3B-Instruct-Q3_K_M.gguf GGUF Q3_K_M 1.57 GB Download
Llama-3.2-3B-Instruct-Q3_K_S.gguf GGUF Q3_K_S 1.44 GB Download
Llama-3.2-3B-Instruct-Q4_K_M.gguf GGUF Q4_K_M 1.88 GB Download
Llama-3.2-3B-Instruct-Q4_K_S.gguf GGUF Q4_K_S 1.80 GB Download
Llama-3.2-3B-Instruct-Q5_K_M.gguf GGUF Q5_K_M 2.16 GB Download
Llama-3.2-3B-Instruct-Q5_K_S.gguf GGUF Q5_K_S 2.11 GB Download
Llama-3.2-3B-Instruct-Q6_K.gguf GGUF Q6_K 2.46 GB Download
Llama-3.2-3B-Instruct-Q8_0.gguf GGUF — 3.19 GB Download

Model Details Live

Model Slug
lm-kit/llama-3.2-3b-instruct.gguf
Author
lm-kit
Pipeline Task
—
Library
—
Created
2024-09-25
Last Modified
2024-09-25
Gated
No
Private
No
HF SHA
ecb442731f0ddc298e3631c2e938837f7f242254
License
llama3.2
Language
Unknown
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "llama3.2",
    "frontmatter": {
      "license": "llama3.2"
    },
    "hero_image_url": "",
    "summary": "## Model Summary This repository hosts quantized versions of the Llama-3.2-3B-Instruct model. **Format:** GGUF **Converter:** llama.cpp 70392f1f81470607ba3afef04aa56c9f65587664 **Quantizer:** LM-Kit.NET 2024.8.4 For more detailed information on the base model, please visit the following link",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: llama3.2\n---\n## Model Summary\n\nThis repository hosts quantized versions of the Llama-3.2-3B-Instruct model.\n\n**Format:** GGUF  \n**Converter:** llama.cpp 70392f1f81470607ba3afef04aa56c9f65587664  \n**Quantizer:** LM-Kit.NET 2024.8.4\n\nFor more detailed information on the base model, please visit the following link\n\n- [Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct)\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "license:llama3.2",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 102,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-25T20:41:36.000Z",
  "created_at": "2024-09-25T20:19:39.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "66f4705b54a6b6ec01071568",
  "id": "lm-kit/llama-3.2-3b-instruct.gguf",
  "modelId": "lm-kit/llama-3.2-3b-instruct.gguf",
  "sha": "ecb442731f0ddc298e3631c2e938837f7f242254",
  "createdAt": "2024-09-25T20:19:39.000Z",
  "lastModified": "2024-09-25T20:41:36.000Z",
  "author": "lm-kit",
  "downloads": 102,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 13
}