Ma7ee7/MeetInstruct-0.6B-v1.5-GGUF overview
MeetInstruct 0.6B v1.5 GGUF GGUF conversions of Ma7ee7/MeetInstruct 0.6B v1.5 https://huggingface.co/Ma7ee7/MeetInstruct 0.6B v1.5 . The model is based on Qwen…
Runs locally from ~331.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| MeetInstruct-0.6B-v1.5-F16.gguf | GGUF | F16 | 1.41 GB | Download |
| MeetInstruct-0.6B-v1.5-Q2_K.gguf | GGUF | Q2_K | 331.2 MB | Download |
| MeetInstruct-0.6B-v1.5-Q3_K_L.gguf | GGUF | Q3_K_L | 415.2 MB | Download |
| MeetInstruct-0.6B-v1.5-Q3_K_M.gguf | GGUF | Q3_K_M | 394.8 MB | Download |
| MeetInstruct-0.6B-v1.5-Q3_K_S.gguf | GGUF | Q3_K_S | 371.9 MB | Download |
| MeetInstruct-0.6B-v1.5-Q4_K_M.gguf | GGUF | Q4_K_M | 461.8 MB | Download |
| MeetInstruct-0.6B-v1.5-Q4_K_S.gguf | GGUF | Q4_K_S | 449.0 MB | Download |
| MeetInstruct-0.6B-v1.5-Q5_K_M.gguf | GGUF | Q5_K_M | 525.8 MB | Download |
| MeetInstruct-0.6B-v1.5-Q5_K_S.gguf | GGUF | Q5_K_S | 518.4 MB | Download |
| MeetInstruct-0.6B-v1.5-Q6_K.gguf | GGUF | Q6_K | 593.9 MB | Download |
| MeetInstruct-0.6B-v1.5-Q8_0.gguf | GGUF | Q8_0 | 767.5 MB | Download |
Model Details
| Model ID | Ma7ee7/MeetInstruct-0.6B-v1.5-GGUF |
|---|---|
| Author | Ma7ee7 |
| Pipeline | text-generation |
| License | — |
| Base model | Ma7ee7/MeetInstruct-0.6B-v1.5 |
| Last modified | 2026-09-04T20:39:43.000Z |
Model README
---
base_model: Ma7ee7/MeetInstruct-0.6B-v1.5
library_name: llama.cpp
pipeline_tag: text-generation
tags:
- gguf
- llama.cpp
- qwen3
- conversational
- text-generation
---
MeetInstruct-0.6B-v1.5 GGUF
GGUF conversions of
Ma7ee7/MeetInstruct-0.6B-v1.5.
The model is based on Qwen3-0.6B and uses its ChatML-compatible chat template.
Files
| File | Size |
|---|---:|
| MeetInstruct-0.6B-v1.5-F16.gguf | 1439.4 MiB |
| MeetInstruct-0.6B-v1.5-Q8_0.gguf | 767.5 MiB |
| MeetInstruct-0.6B-v1.5-Q6_K.gguf | 593.9 MiB |
| MeetInstruct-0.6B-v1.5-Q5_K_M.gguf | 525.8 MiB |
| MeetInstruct-0.6B-v1.5-Q5_K_S.gguf | 518.4 MiB |
| MeetInstruct-0.6B-v1.5-Q4_K_M.gguf | 461.8 MiB |
| MeetInstruct-0.6B-v1.5-Q4_K_S.gguf | 449.0 MiB |
| MeetInstruct-0.6B-v1.5-Q3_K_L.gguf | 415.2 MiB |
| MeetInstruct-0.6B-v1.5-Q3_K_M.gguf | 394.8 MiB |
| MeetInstruct-0.6B-v1.5-Q3_K_S.gguf | 371.9 MiB |
| MeetInstruct-0.6B-v1.5-Q2_K.gguf | 331.2 MiB |
Recommended general-purpose quantization: MeetInstruct-0.6B-v1.5-Q4_K_M.gguf.
llama.cpp
Run the model with:
llama-cli -m MeetInstruct-0.6B-v1.5-Q4_K_M.gguf -cnv
Context support depends on the underlying checkpoint and available memory.
The v1.5 16K checkpoint was trained with examples between approximately
10,000 and 15,900 tokens, but long-context reliability is not guaranteed.
Quantizations
Generated locally using the current llama.cpp quantizer.
Successful quantizations: Q8_0, Q6_K, Q5_K_M, Q5_K_S, Q4_K_M, Q4_K_S, Q3_K_L, Q3_K_M, Q3_K_S, Q2_K.
Run Ma7ee7/MeetInstruct-0.6B-v1.5-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models