GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Ma7ee7/MeetInstruct-0.6B-v1.5-GGUF overview

MeetInstruct 0.6B v1.5 GGUF GGUF conversions of Ma7ee7/MeetInstruct 0.6B v1.5 https://huggingface.co/Ma7ee7/MeetInstruct 0.6B v1.5 . The model is based on Qwen…

llama.cppggufqwen3conversationaltext-generationbase_model:Ma7ee7/MeetInstruct-0.6B-v1.5base_model:quantized:Ma7ee7/MeetInstruct-0.6B-v1.5endpoints_compatibleregion:us

Runs locally from ~331.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

11 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
MeetInstruct-0.6B-v1.5-F16.ggufGGUFF161.41 GBDownload
MeetInstruct-0.6B-v1.5-Q2_K.ggufGGUFQ2_K331.2 MBDownload
MeetInstruct-0.6B-v1.5-Q3_K_L.ggufGGUFQ3_K_L415.2 MBDownload
MeetInstruct-0.6B-v1.5-Q3_K_M.ggufGGUFQ3_K_M394.8 MBDownload
MeetInstruct-0.6B-v1.5-Q3_K_S.ggufGGUFQ3_K_S371.9 MBDownload
MeetInstruct-0.6B-v1.5-Q4_K_M.ggufGGUFQ4_K_M461.8 MBDownload
MeetInstruct-0.6B-v1.5-Q4_K_S.ggufGGUFQ4_K_S449.0 MBDownload
MeetInstruct-0.6B-v1.5-Q5_K_M.ggufGGUFQ5_K_M525.8 MBDownload
MeetInstruct-0.6B-v1.5-Q5_K_S.ggufGGUFQ5_K_S518.4 MBDownload
MeetInstruct-0.6B-v1.5-Q6_K.ggufGGUFQ6_K593.9 MBDownload
MeetInstruct-0.6B-v1.5-Q8_0.ggufGGUFQ8_0767.5 MBDownload

Model Details

Model IDMa7ee7/MeetInstruct-0.6B-v1.5-GGUF
AuthorMa7ee7
Pipelinetext-generation
License
Base modelMa7ee7/MeetInstruct-0.6B-v1.5
Last modified2026-09-04T20:39:43.000Z

Model README

---

base_model: Ma7ee7/MeetInstruct-0.6B-v1.5

library_name: llama.cpp

pipeline_tag: text-generation

tags:

  • gguf
  • llama.cpp
  • qwen3
  • conversational
  • text-generation

---

MeetInstruct-0.6B-v1.5 GGUF

GGUF conversions of

Ma7ee7/MeetInstruct-0.6B-v1.5.

The model is based on Qwen3-0.6B and uses its ChatML-compatible chat template.

Files

| File | Size |

|---|---:|

| MeetInstruct-0.6B-v1.5-F16.gguf | 1439.4 MiB |

| MeetInstruct-0.6B-v1.5-Q8_0.gguf | 767.5 MiB |

| MeetInstruct-0.6B-v1.5-Q6_K.gguf | 593.9 MiB |

| MeetInstruct-0.6B-v1.5-Q5_K_M.gguf | 525.8 MiB |

| MeetInstruct-0.6B-v1.5-Q5_K_S.gguf | 518.4 MiB |

| MeetInstruct-0.6B-v1.5-Q4_K_M.gguf | 461.8 MiB |

| MeetInstruct-0.6B-v1.5-Q4_K_S.gguf | 449.0 MiB |

| MeetInstruct-0.6B-v1.5-Q3_K_L.gguf | 415.2 MiB |

| MeetInstruct-0.6B-v1.5-Q3_K_M.gguf | 394.8 MiB |

| MeetInstruct-0.6B-v1.5-Q3_K_S.gguf | 371.9 MiB |

| MeetInstruct-0.6B-v1.5-Q2_K.gguf | 331.2 MiB |

Recommended general-purpose quantization: MeetInstruct-0.6B-v1.5-Q4_K_M.gguf.

llama.cpp

Run the model with:

llama-cli -m MeetInstruct-0.6B-v1.5-Q4_K_M.gguf -cnv

Context support depends on the underlying checkpoint and available memory.

The v1.5 16K checkpoint was trained with examples between approximately

10,000 and 15,900 tokens, but long-context reliability is not guaranteed.

Quantizations

Generated locally using the current llama.cpp quantizer.

Successful quantizations: Q8_0, Q6_K, Q5_K_M, Q5_K_S, Q4_K_M, Q4_K_S, Q3_K_L, Q3_K_M, Q3_K_S, Q2_K.

Run Ma7ee7/MeetInstruct-0.6B-v1.5-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models