richarderkhov/vilm_-_vinallama-7b-chat-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "https://i.ibb.co/W0dq12n/vinallama.png",
    "summary": "!image Read our Paper ### Prompt Format (ChatML): `` system Bạn là một trợ lí AI hữu ích. Hãy trả lời người dùng một cách chính xác.  user Hello world! assistant ``",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nvinallama-7b-chat - GGUF\n- Model creator: https://huggingface.co/vilm/\n- Original model: https://huggingface.co/vilm/vinallama-7b-chat/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [vinallama-7b-chat.Q2_K.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q2_K.gguf) | Q2_K | 2.42GB |\n| [vinallama-7b-chat.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.IQ3_XS.gguf) | IQ3_XS | 2.67GB |\n| [vinallama-7b-chat.IQ3_S.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.IQ3_S.gguf) | IQ3_S | 2.81GB |\n| [vinallama-7b-chat.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q3_K_S.gguf) | Q3_K_S | 2.81GB |\n| [vinallama-7b-chat.IQ3_M.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.IQ3_M.gguf) | IQ3_M | 2.97GB |\n| [vinallama-7b-chat.Q3_K.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q3_K.gguf) | Q3_K | 3.14GB |\n| [vinallama-7b-chat.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q3_K_M.gguf) | Q3_K_M | 3.14GB |\n| [vinallama-7b-chat.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q3_K_L.gguf) | Q3_K_L | 3.42GB |\n| [vinallama-7b-chat.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.IQ4_XS.gguf) | IQ4_XS | 3.47GB |\n| [vinallama-7b-chat.Q4_0.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q4_0.gguf) | Q4_0 | 3.64GB |\n| [vinallama-7b-chat.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.IQ4_NL.gguf) | IQ4_NL | 3.66GB |\n| [vinallama-7b-chat.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q4_K_S.gguf) | Q4_K_S | 3.67GB |\n| [vinallama-7b-chat.Q4_K.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q4_K.gguf) | Q4_K | 3.88GB |\n| [vinallama-7b-chat.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q4_K_M.gguf) | Q4_K_M | 3.88GB |\n| [vinallama-7b-chat.Q4_1.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q4_1.gguf) | Q4_1 | 4.03GB |\n| [vinallama-7b-chat.Q5_0.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q5_0.gguf) | Q5_0 | 4.41GB |\n| [vinallama-7b-chat.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q5_K_S.gguf) | Q5_K_S | 4.41GB |\n| [vinallama-7b-chat.Q5_K.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q5_K.gguf) | Q5_K | 4.54GB |\n| [vinallama-7b-chat.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q5_K_M.gguf) | Q5_K_M | 4.54GB |\n| [vinallama-7b-chat.Q5_1.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q5_1.gguf) | Q5_1 | 4.8GB |\n| [vinallama-7b-chat.Q6_K.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q6_K.gguf) | Q6_K | 5.24GB |\n| [vinallama-7b-chat.Q8_0.gguf](https://huggingface.co/RichardErkhov/vilm_-_vinallama-7b-chat-gguf/blob/main/vinallama-7b-chat.Q8_0.gguf) | Q8_0 | 6.79GB |\n\n\n\n\nOriginal model description:\n---\nlanguage:\n- vi\nlicense: llama2\n---\n\n# VinaLLaMA - State-of-the-art Vietnamese LLMs\n\n![image](https://i.ibb.co/W0dq12n/vinallama.png)\n\nRead our [Paper](https://huggingface.co/papers/2312.11011)\n\n### Prompt Format (ChatML):\n\n```\n<|im_start|>system\nBạn là một trợ lí AI hữu ích. Hãy trả lời người dùng một cách chính xác.\n<|im_end|>\n<|im_start|>user\nHello world!<|im_end|>\n<|im_start|>assistant\n```\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "arxiv:2312.11011",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 853,
  "gated": false,
  "private": false,
  "last_modified": "2024-07-31T06:26:47.000Z",
  "created_at": "2024-07-31T04:37:35.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66a9bf8f2df7f4b31ec0c56f",
  "id": "RichardErkhov/vilm_-_vinallama-7b-chat-gguf",
  "modelId": "RichardErkhov/vilm_-_vinallama-7b-chat-gguf",
  "sha": "6089d314d3f0a32ae63db7d76bfac1f7506d64e8",
  "createdAt": "2024-07-31T04:37:35.000Z",
  "lastModified": "2024-07-31T06:26:47.000Z",
  "author": "RichardErkhov",
  "downloads": 853,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}