Model Intelligence Sheet
mparvin/phi-2-GGUF overview
phi 2 GGUF GGUF conversions of microsoft/phi 2 https://huggingface.co/microsoft/phi 2 . These weights were converted with llama.cpp https://github.com/ggergano…
Runs locally from ~1.62 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
Model README
---
base_model: microsoft/phi-2
tags:
- gguf
- quantized
- llama.cpp
---
phi-2-GGUF
GGUF conversions of microsoft/phi-2.
These weights were converted with llama.cpp and quantized for local / Ollama use. This is not the original model; it is a community conversion of the source weights.
Quantizations
Q4_K_M, Q5_K_M, Q8_0
Source
- Base model: microsoft/phi-2
- Converted by HF-2-GGUF
Run mparvin/phi-2-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models