GraySoft
Projects Models About FAQ Contact Download guIDE →

lm-kit/phi-3-medium-4k-14b-instruct-gguf Q8_0 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

lm-kit/phi-3-medium-4k-14b-instruct-gguf overview

This repository hosts quantized versions of the Phi-3-Medium-4K-Instruct model. Format: GGUF Converter: llama.cpp afbb4c1322a747d2a7b4bf67c868148f8afcc6c8 Quantizer: LM-Kit.NET 2024.7.10 For more detailed information on the base model, please visit the following link:

gguflicense:mitendpoints_compatibleregion:usconversational
lm-kit/phi-3-medium-4k-14b-instruct-gguf visual
Downloads
97
Likes
0
Pipeline
—
Library
—
Visibility
Public
Access
Open

Repository Files & Downloads

10 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Phi-3-medium-4k-Instruct-F16.gguf GGUF F16 26.00 GB Download
Phi-3-medium-4k-Instruct-Q2_K.gguf GGUF Q2_K 4.79 GB Download
Phi-3-medium-4k-Instruct-Q3_K_M.gguf GGUF Q3_K_M 6.45 GB Download
Phi-3-medium-4k-Instruct-Q3_K_S.gguf GGUF Q3_K_S 5.65 GB Download
Phi-3-medium-4k-Instruct-Q4_K_M.gguf GGUF Q4_K_M 7.98 GB Download
Phi-3-medium-4k-Instruct-Q4_K_S.gguf GGUF Q4_K_S 7.41 GB Download
Phi-3-medium-4k-Instruct-Q5_K_M.gguf GGUF Q5_K_M 9.38 GB Download
Phi-3-medium-4k-Instruct-Q5_K_S.gguf GGUF Q5_K_S 8.96 GB Download
Phi-3-medium-4k-Instruct-Q6_K.gguf GGUF Q6_K 10.67 GB Download
Phi-3-medium-4k-Instruct-Q8_0.gguf GGUF — 13.82 GB Download

Model Details Live

Model Slug
lm-kit/phi-3-medium-4k-14b-instruct-gguf
Author
lm-kit
Pipeline Task
—
Library
—
Created
2024-08-04
Last Modified
2024-12-26
Gated
No
Private
No
HF SHA
f1c55dace651f238967df7573ecfea69f6f0dcc5
License
mit
Language
Unknown
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "mit",
    "frontmatter": {
      "license": "mit"
    },
    "hero_image_url": "",
    "summary": "This repository hosts quantized versions of the Phi-3-Medium-4K-Instruct model. **Format:** GGUF **Converter:** llama.cpp afbb4c1322a747d2a7b4bf67c868148f8afcc6c8 **Quantizer:** LM-Kit.NET 2024.7.10 For more detailed information on the base model, please visit the following link:",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: mit\n---\n\nThis repository hosts quantized versions of the Phi-3-Medium-4K-Instruct model.\n\n**Format:** GGUF  \n**Converter:** llama.cpp afbb4c1322a747d2a7b4bf67c868148f8afcc6c8  \n**Quantizer:** LM-Kit.NET 2024.7.10\n\nFor more detailed information on the base model, please visit the following link:\n\n- [Phi-3-Medium-4K-Instruct](https://huggingface.co/microsoft/Phi-3-medium-4k-instruct)",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "license:mit",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 97,
  "gated": false,
  "private": false,
  "last_modified": "2024-12-26T13:17:51.000Z",
  "created_at": "2024-08-04T11:20:29.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "66af63fde48856bb715dc4e6",
  "id": "lm-kit/phi-3-medium-4k-14b-instruct-gguf",
  "modelId": "lm-kit/phi-3-medium-4k-14b-instruct-gguf",
  "sha": "f1c55dace651f238967df7573ecfea69f6f0dcc5",
  "createdAt": "2024-08-04T11:20:29.000Z",
  "lastModified": "2024-12-26T13:17:51.000Z",
  "author": "lm-kit",
  "downloads": 97,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 12
}