GraySoft
Projects Models About FAQ Contact Download guIDE →

devquasar/microsoft.phi-4-mini-instruct-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

devquasar/microsoft.phi-4-mini-instruct-gguf overview

Quantized version of: microsoft/Phi-4-mini-instruct 'Make knowledge free for everyone' Big thanks to ns3284! (https://github.com/ns3284/llama.cpp/tree/dev/ns3284/phi4minisupport) Made with

gguftext-generationbase_model:microsoft/Phi-4-mini-instructbase_model:quantized:microsoft/Phi-4-mini-instructendpoints_compatibleregion:usconversational
devquasar/microsoft.phi-4-mini-instruct-gguf visual
Downloads
217
Likes
2
Pipeline
text-generation
Library
Visibility
Public
Access
Open

Repository Files & Downloads

11 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
microsoft.Phi-4-mini-instruct.Q2_K.gguf GGUF Q2_K 1.57 GB Download
microsoft.Phi-4-mini-instruct.Q3_K_L.gguf GGUF Q3_K_L 2.10 GB Download
microsoft.Phi-4-mini-instruct.Q3_K_M.gguf GGUF Q3_K_M 1.97 GB Download
microsoft.Phi-4-mini-instruct.Q3_K_S.gguf GGUF Q3_K_S 1.77 GB Download
microsoft.Phi-4-mini-instruct.Q4_K_M.gguf GGUF Q4_K_M 2.32 GB Download
microsoft.Phi-4-mini-instruct.Q4_K_S.gguf GGUF Q4_K_S 2.18 GB Download
microsoft.Phi-4-mini-instruct.Q5_K_M.gguf GGUF Q5_K_M 2.65 GB Download
microsoft.Phi-4-mini-instruct.Q5_K_S.gguf GGUF Q5_K_S 2.54 GB Download
microsoft.Phi-4-mini-instruct.Q6_K.gguf GGUF Q6_K 2.94 GB Download
microsoft.Phi-4-mini-instruct.Q8_0.gguf GGUF 3.80 GB Download
microsoft.Phi-4-mini-instruct.f16.gguf GGUF F16 7.15 GB Download

Model Details Live

Model Slug
devquasar/microsoft.phi-4-mini-instruct-gguf
Author
DevQuasar
Pipeline Task
text-generation
Library
Created
2025-02-27
Last Modified
2025-02-28
Gated
No
Private
No
HF SHA
bc507d570375104c23d30e238e9ac597ea15edd1
License
Unknown
Language
Unknown
Base Model
microsoft/Phi-4-mini-instruct

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": [
      "microsoft/Phi-4-mini-instruct"
    ],
    "pipeline_tag": "text-generation",
    "frontmatter": {
      "base_model": [
        "microsoft/Phi-4-mini-instruct"
      ],
      "pipeline_tag": "text-generation"
    },
    "hero_image_url": "https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dq_logo_black-transparent.png",
    "summary": "Quantized version of: microsoft/Phi-4-mini-instruct 'Make knowledge free for everyone' Big thanks to ns3284! (https://github.com/ns3284/llama.cpp/tree/dev/ns3284/phi4_mini_support)  Made with",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model:\n- microsoft/Phi-4-mini-instruct\npipeline_tag: text-generation\n---\n\n[<img src=\"https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dq_logo_black-transparent.png\" width=\"200\"/>](https://devquasar.com)\n\nQuantized version of: [microsoft/Phi-4-mini-instruct](https://huggingface.co/microsoft/Phi-4-mini-instruct)\n\n'Make knowledge free for everyone'\n\nBig thanks to ns3284! \n(https://github.com/ns3284/llama.cpp/tree/dev/ns3284/phi4_mini_support)\n\n<p align=\"center\">\n  Made with <br>\n  <a href=\"https://www.civo.com/\" target=\"_blank\">\n    <img src=\"https://www.civo.com/assets/public/brand-assets/civo-logo-colour-60cc1622dedf346f7afde1fff760523f731b0aac106a5465af98ff4073114b74.svg\" width=\"100\"/>\n  </a>\n</p>\n\n<a href='https://ko-fi.com/L4L416YX7C' target='_blank'><img height='36' style='border:0px;height:36px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com' /></a>\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "text-generation",
    "base_model:microsoft/Phi-4-mini-instruct",
    "base_model:quantized:microsoft/Phi-4-mini-instruct",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 2,
  "downloads": 217,
  "gated": false,
  "private": false,
  "last_modified": "2025-02-28T05:09:51.000Z",
  "created_at": "2025-02-27T20:40:07.000Z",
  "pipeline_tag": "text-generation",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "67c0cda73c06fb09ae4e37d2",
  "id": "DevQuasar/microsoft.Phi-4-mini-instruct-GGUF",
  "modelId": "DevQuasar/microsoft.Phi-4-mini-instruct-GGUF",
  "sha": "bc507d570375104c23d30e238e9ac597ea15edd1",
  "createdAt": "2025-02-27T20:40:07.000Z",
  "lastModified": "2025-02-28T05:09:51.000Z",
  "author": "DevQuasar",
  "downloads": 217,
  "likes": 2,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "",
  "siblings_count": 13
}