GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

vvnaren/Phi-3.1-mini-128k-instruct-lora-base-F16-GGUF overview

vvnaren/Phi 3.1 mini 128k instruct lora base F16 GGUF This LoRA adapter was converted to GGUF format from tuong nguyen prd/Phi 3.1 mini 128k instruct lora base…

peftggufllama-cppgguf-my-lorabase_model:tuong-nguyen-prd/Phi-3.1-mini-128k-instruct-lora-basebase_model:adapter:tuong-nguyen-prd/Phi-3.1-mini-128k-instruct-lora-baseregion:us

Runs locally from ~3.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Phi-3.1-mini-128k-instruct-lora-base-f16.ggufGGUFF163.0 MBDownload

Model Details

Model IDvvnaren/Phi-3.1-mini-128k-instruct-lora-base-F16-GGUF
Authorvvnaren
Pipeline
License
Base modeltuong-nguyen-prd/Phi-3.1-mini-128k-instruct-lora-base
Last modified2026-07-17T05:16:55.000Z

Model README

---

library_name: peft

base_model: tuong-nguyen-prd/Phi-3.1-mini-128k-instruct-lora-base

tags:

  • llama-cpp
  • gguf-my-lora

---

vvnaren/Phi-3.1-mini-128k-instruct-lora-base-F16-GGUF

This LoRA adapter was converted to GGUF format from tuong-nguyen-prd/Phi-3.1-mini-128k-instruct-lora-base via the ggml.ai's GGUF-my-lora space.

Refer to the original adapter repository for more details.

Use with llama.cpp

# with cli
llama-cli -m base_model.gguf --lora Phi-3.1-mini-128k-instruct-lora-base-f16.gguf (...other args)

# with server
llama-server -m base_model.gguf --lora Phi-3.1-mini-128k-instruct-lora-base-f16.gguf (...other args)

To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.

Run vvnaren/Phi-3.1-mini-128k-instruct-lora-base-F16-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models