GraySoft
Projects Models About FAQ Contact Download guIDE →

lm-kit/phi-3.5-mini-3.8b-instruct-gguf Q3_K_L GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

lm-kit/phi-3.5-mini-3.8b-instruct-gguf overview

Comprehensive model page for lm-kit/phi-3.5-mini-3.8b-instruct-gguf

gguflicense:mitendpoints_compatibleregion:usconversational
lm-kit/phi-3.5-mini-3.8b-instruct-gguf visual
Downloads
1,085
Likes
3
Pipeline
—
Library
—
Visibility
Public
Access
Open

Repository Files & Downloads

11 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Phi-3.5-mini-Instruct-F16.gguf GGUF F16 7.12 GB Download
Phi-3.5-mini-Instruct-Q2_K.gguf GGUF Q2_K 1.32 GB Download
Phi-3.5-mini-Instruct-Q3_K_L.gguf GGUF Q3_K_L 1.94 GB Download
Phi-3.5-mini-Instruct-Q3_K_M.gguf GGUF Q3_K_M 1.82 GB Download
Phi-3.5-mini-Instruct-Q3_K_S.gguf GGUF Q3_K_S 1.57 GB Download
Phi-3.5-mini-Instruct-Q4_K_M.gguf GGUF Q4_K_M 2.23 GB Download
Phi-3.5-mini-Instruct-Q4_K_S.gguf GGUF Q4_K_S 2.04 GB Download
Phi-3.5-mini-Instruct-Q5_K_M.gguf GGUF Q5_K_M 2.62 GB Download
Phi-3.5-mini-Instruct-Q5_K_S.gguf GGUF Q5_K_S 2.46 GB Download
Phi-3.5-mini-Instruct-Q6_K.gguf GGUF Q6_K 2.92 GB Download
Phi-3.5-mini-Instruct-Q8_0.gguf GGUF — 3.78 GB Download

Model Details Live

Model Slug
lm-kit/phi-3.5-mini-3.8b-instruct-gguf
Author
lm-kit
Pipeline Task
—
Library
—
Created
2024-08-20
Last Modified
2024-09-25
Gated
No
Private
No
HF SHA
3c211cc2839bd02ad2a24340ce8d08f8f230cb93
License
mit
Language
Unknown
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "mit",
    "frontmatter": {
      "license": "mit"
    },
    "hero_image_url": "",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: mit\n---\n\n## Model Summary\n\nThis repository hosts quantized versions of the Phi-3.5-mini-instruct model.\n\n**Format:** GGUF  \n**Converter:** llama.cpp 2f3c1466ff46a2413b0e363a5005c46538186ee6  \n**Quantizer:** LM-Kit.NET 2024.8.2\n\nFor more detailed information on the base model, please visit the following link\n\n- [Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct)\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "license:mit",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 3,
  "downloads": 1085,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-25T20:16:11.000Z",
  "created_at": "2024-08-20T19:51:16.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "66c4f3b4e8f01fe34e873532",
  "id": "lm-kit/phi-3.5-mini-3.8b-instruct-gguf",
  "modelId": "lm-kit/phi-3.5-mini-3.8b-instruct-gguf",
  "sha": "3c211cc2839bd02ad2a24340ce8d08f8f230cb93",
  "createdAt": "2024-08-20T19:51:16.000Z",
  "lastModified": "2024-09-25T20:16:11.000Z",
  "author": "lm-kit",
  "downloads": 1085,
  "likes": 3,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 13
}