What is Way56/Mai-5B-GGUF?

Way56/Mai-5B-GGUF is a GGUF-quantized model for local AI inference.

What license applies to Way56/Mai-5B-GGUF?

License: See model card. Verify terms on Hugging Face before commercial use.

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Model Intelligence Sheet

Way56/Mai-5B-GGUF GGUF downloads for local AI inference with guIDE.

ggufendpoints_compatibleregion:usimatrixconversational

Runs locally from ~2.91 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads

Likes

Pipeline

—

Author

3 GGUF files detected

Direct downloads for local inference

File	Type	Quantization	Size	Link
Mai-IQ4_NL.gguf	GGUF	IQ4_NL	2.91 GB	Download
Mai-Q5_K_M.gguf	GGUF	Q5_K_M	3.45 GB	Download
Mai-Q6_K.gguf	GGUF	Q6_K	3.91 GB	Download

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.