richarderkhov/maziyarpanahi_-_calme-7b-instruct-v0.5-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/5fd5e18a90b6dc4633f6d292/LzEf6vvq2qIiys-q7l9Hq.webp",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nCalme-7B-Instruct-v0.5 - GGUF\n- Model creator: https://huggingface.co/MaziyarPanahi/\n- Original model: https://huggingface.co/MaziyarPanahi/Calme-7B-Instruct-v0.5/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [Calme-7B-Instruct-v0.5.Q2_K.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q2_K.gguf) | Q2_K | 2.53GB |\n| [Calme-7B-Instruct-v0.5.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.IQ3_XS.gguf) | IQ3_XS | 2.81GB |\n| [Calme-7B-Instruct-v0.5.IQ3_S.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.IQ3_S.gguf) | IQ3_S | 2.96GB |\n| [Calme-7B-Instruct-v0.5.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q3_K_S.gguf) | Q3_K_S | 2.95GB |\n| [Calme-7B-Instruct-v0.5.IQ3_M.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.IQ3_M.gguf) | IQ3_M | 3.06GB |\n| [Calme-7B-Instruct-v0.5.Q3_K.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q3_K.gguf) | Q3_K | 3.28GB |\n| [Calme-7B-Instruct-v0.5.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q3_K_M.gguf) | Q3_K_M | 3.28GB |\n| [Calme-7B-Instruct-v0.5.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q3_K_L.gguf) | Q3_K_L | 3.56GB |\n| [Calme-7B-Instruct-v0.5.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.IQ4_XS.gguf) | IQ4_XS | 3.67GB |\n| [Calme-7B-Instruct-v0.5.Q4_0.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q4_0.gguf) | Q4_0 | 3.83GB |\n| [Calme-7B-Instruct-v0.5.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.IQ4_NL.gguf) | IQ4_NL | 3.87GB |\n| [Calme-7B-Instruct-v0.5.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q4_K_S.gguf) | Q4_K_S | 3.86GB |\n| [Calme-7B-Instruct-v0.5.Q4_K.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q4_K.gguf) | Q4_K | 4.07GB |\n| [Calme-7B-Instruct-v0.5.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q4_K_M.gguf) | Q4_K_M | 4.07GB |\n| [Calme-7B-Instruct-v0.5.Q4_1.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q4_1.gguf) | Q4_1 | 4.24GB |\n| [Calme-7B-Instruct-v0.5.Q5_0.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q5_0.gguf) | Q5_0 | 4.65GB |\n| [Calme-7B-Instruct-v0.5.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q5_K_S.gguf) | Q5_K_S | 4.65GB |\n| [Calme-7B-Instruct-v0.5.Q5_K.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q5_K.gguf) | Q5_K | 4.78GB |\n| [Calme-7B-Instruct-v0.5.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q5_K_M.gguf) | Q5_K_M | 4.78GB |\n| [Calme-7B-Instruct-v0.5.Q5_1.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q5_1.gguf) | Q5_1 | 5.07GB |\n| [Calme-7B-Instruct-v0.5.Q6_K.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q6_K.gguf) | Q6_K | 5.53GB |\n| [Calme-7B-Instruct-v0.5.Q8_0.gguf](https://huggingface.co/RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf/blob/main/Calme-7B-Instruct-v0.5.Q8_0.gguf) | Q8_0 | 7.17GB |\n\n\n\n\nOriginal model description:\n---\nlicense: apache-2.0\ntags:\n- generated_from_trainer\n- mistral\n- 7b\n- calme\nmodel-index:\n- name: Calme-7B-Instruct-v0.5\n  results: []\nmodel_name: Calme-7B-Instruct-v0.5\ninference: false\nmodel_creator: MaziyarPanahi\npipeline_tag: text-generation\nquantized_by: MaziyarPanahi\n---\n\n<img src=\"https://cdn-uploads.huggingface.co/production/uploads/5fd5e18a90b6dc4633f6d292/LzEf6vvq2qIiys-q7l9Hq.webp\" width=\"550\" />\n\n# MaziyarPanahi/Calme-7B-Instruct-v0.5\n\n## Model Description\n\nCalme-7B is a state-of-the-art language model with 7 billion parameters, fine-tuned over high-quality datasets on top of Mistral-7B. The Calme-7B models excel in generating text that resonates with clarity, calmness, and coherence.\n\n### How to Use\n\n```python\n# Use a pipeline as a high-level helper\nfrom transformers import pipeline\n\npipe = pipeline(\"text-generation\", model=\"MaziyarPanahi/Calme-7B-Instruct-v0.5\")\n\n# Load model directly\nfrom transformers import AutoTokenizer, AutoModelForCausalLM\n\ntokenizer = AutoTokenizer.from_pretrained(\"MaziyarPanahi/Calme-7B-Instruct-v0.5\")\nmodel = AutoModelForCausalLM.from_pretrained(\"MaziyarPanahi/Calme-7B-Instruct-v0.5\")\n```\n\n### Quantized Models\n\n> I love how GGUF democratizes the use of Large Language Models (LLMs) on commodity hardware, more specifically, personal computers without any accelerated hardware. Because of this, I am committed to converting and quantizing any models I fine-tune to make them accessible to everyone!\n\n- GGUF (2/3/4/5/6/8 bits): [MaziyarPanahi/Calme-7B-Instruct-v0.5-GGUF](https://huggingface.co/MaziyarPanahi/Calme-7B-Instruct-v0.5-GGUF)\n\n## Examples\n\n```\n<s>[INST] You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\n\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.\n\ndescribe about pros and cons of docker system. [/INST]\n```\n\n<details>\n  <summary>Show me the response</summary>\n  \n  ```\n\n  ```\n  \n</details>\n\n\n```\n\n```\n\n<details>\n  <summary>Show me the response</summary>\n  \n  ```\n\n  ```\n  \n</details>\n\n\n```\n<s> [INST] Mark is faster than Mary, Mary is faster than Joe. Is Joe faster than Mark? Let's think step by step [/INST]\n```\n\n<details>\n  <summary>Show me the response</summary>\n  \n  ```\n\n  ```\n  \n</details>\n\n\n```\n\n```\n\n<details>\n  <summary>Show me the response</summary>\n  \n  ``` \n\n  ```\n  \n</details>\n\n\n```\n<s> [INST] explain step by step 25-4*2+3=? [/INST]\n```\n\n<details>\n  <summary>Show me the response</summary>\n  \n  ```\n\n  ```  \n</details>\n\n\n**Multilingual:**\n\n```\n<s> [INST] Vous êtes un assistant utile, respectueux et honnête. Répondez toujours de la manière la plus utile possible, tout en étant sûr. Vos réponses ne doivent inclure aucun contenu nuisible, contraire à l'éthique, raciste, sexiste, toxique, dangereux ou illégal. Assurez-vous que vos réponses sont socialement impartiales et de nature positive.\n\nSi une question n'a pas de sens ou n'est pas cohérente d'un point de vue factuel, expliquez pourquoi au lieu de répondre quelque chose d'incorrect. Si vous ne connaissez pas la réponse à une question, veuillez ne pas partager de fausses informations.\n\nDécrivez les avantages et les inconvénients du système Docker.[/INST]\n```\n\n<details>\n  <summary>Show me the response</summary>\n  \n  ```\n\n  ```\n\n<details>\n  <summary>Show me the response</summary>\n  \n  ```\n\n  ```\n  \n</details>\n\n\n```\n<s>[INST] Ви - корисний, поважний та чесний помічник. Завжди відповідайте максимально корисно, будучи безпечним. Ваші відповіді не повинні містити шкідливого, неетичного, расистського, сексистського, токсичного, небезпечного або нелегального контенту. Будь ласка, переконайтеся, що ваші відповіді соціально неупереджені та мають позитивний характер.\n\nЯкщо питання не має сенсу або не є фактично послідовним, поясніть чому, замість того, щоб відповідати щось некоректне. Якщо ви не знаєте відповіді на питання, будь ласка, не діліться неправдивою інформацією.\n\nОпис про переваги та недоліки системи Docker.[/INST] \n```\n\n<details>\n  <summary>Show me the response</summary>\n  \n  ```\n\n  ```\n  \n</details>\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 121,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-13T16:16:49.000Z",
  "created_at": "2024-09-13T10:45:13.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66e417b9ec0343c253ea628b",
  "id": "RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf",
  "modelId": "RichardErkhov/MaziyarPanahi_-_Calme-7B-Instruct-v0.5-gguf",
  "sha": "ac3f0b2221212e9bd00bef4eefc92305e7db7a4d",
  "createdAt": "2024-09-13T10:45:13.000Z",
  "lastModified": "2024-09-13T16:16:49.000Z",
  "author": "RichardErkhov",
  "downloads": 121,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}