insait-institute/mamaylm-gemma-3-12b-it-v1.0-gguf Q5_K_S GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
insait-institute/mamaylm-gemma-3-12b-it-v1.0-gguf overview
MamayLM-Gemma-3-12B-IT-v1.0-GGUF MamayLM is distributed under Gemma Terms of Use. This repo contains the GGUF format model files for INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0.
Downloads
381
Likes
16
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
4 files detected
Direct downloads for all repository files
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "gemma",
"language": [
"uk",
"en"
],
"base_model": [
"google/gemma-3-12b-it",
"google/gemma-3-12b"
],
"frontmatter": {
"license": "gemma",
"language": [
"uk",
"en"
],
"base_model": [
"google/gemma-3-12b-it",
"google/gemma-3-12b"
]
},
"hero_image_url": "",
"summary": "# MamayLM-Gemma-3-12B-IT-v1.0-GGUF MamayLM is distributed under Gemma Terms of Use. This repo contains the GGUF format model files for INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: gemma\nlanguage:\n- uk\n- en\nbase_model:\n- google/gemma-3-12b-it\n- google/gemma-3-12b\n---\n# MamayLM-Gemma-3-12B-IT-v1.0-GGUF\n\nMamayLM is distributed under [Gemma Terms of Use](https://ai.google.dev/gemma/terms).\n\nThis repo contains the GGUF format model files for [INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0](https://huggingface.co/INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0).\n\n## Quick Start using Python\n\nInstall the required package:\n```bash\npip install llama-cpp-python\n```\n\nExample chat completion:\n\n```python\nfrom llama_cpp import Llama\n\nllm = Llama(\n model_path=\"path/to/your/model.gguf\",\n n_ctx=128000,\n penalize_nl=False\n)\n\nmessages = [{\"role\": \"user\", \"content\": \"Хто такий Козак Мамай??\"}]\nresponse = llm.create_chat_completion(\n messages=messages,\n max_tokens=2048, # Choose maximum generated tokens\n temperature=0.1,\n top_p=0.9,\n repeat_penalty=1.0,\n stop=[\"<eos>\", \"<end_of_turn>\"]\n)\n\n\n```\n\nExample normal completion:\n\n```python\nfrom llama_cpp import Llama\n\nllm = Llama(\n model_path=\"path/to/your/model.gguf\",\n n_ctx=128000,\n penalize_nl=False\n)\n\nprompt = \"<start_of_turn>user\\nХто такий Козак Мамай?<end_of_turn>\\n<start_of_turn>model\\n\"\nresponse = llm(\n prompt,\n max_tokens=2048, # Choose maximum generated tokens\n temperature=0.1,\n top_p=0.9,\n repeat_penalty=1.0,\n stop=[\"<eos>\",\"<end_of_turn>\"]\n)\n```",
"related_quantizations": []
},
"tags": [
"gguf",
"uk",
"en",
"base_model:google/gemma-3-12b-it",
"base_model:quantized:google/gemma-3-12b-it",
"license:gemma",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 16,
"downloads": 381,
"gated": false,
"private": false,
"last_modified": "2025-09-09T08:32:58.000Z",
"created_at": "2025-09-03T10:05:45.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "68b812f9c8fb49a1837fa84f",
"id": "INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0-GGUF",
"modelId": "INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0-GGUF",
"sha": "1ac90452f8f26687babf969b35d1ea3c0cac4616",
"createdAt": "2025-09-03T10:05:45.000Z",
"lastModified": "2025-09-09T08:32:58.000Z",
"author": "INSAIT-Institute",
"downloads": 381,
"likes": 16,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 6
}