insait-institute/bggpt-gemma-2-27b-it-v1.0-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "gemma",
    "frontmatter": {
      "license": "gemma"
    },
    "hero_image_url": "",
    "summary": "# BgGPT-Gemma-2-27B-IT-v1.0-GGUF BgGPT is distributed under Gemma Terms of Use. This repo contains the GGUF format model files for INSAIT-Institute/BgGPT-Gemma-2-27B-IT-v1.0.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: gemma\n---\n# BgGPT-Gemma-2-27B-IT-v1.0-GGUF\n\nBgGPT is distributed under [Gemma Terms of Use](https://ai.google.dev/gemma/terms).\n\nThis repo contains the GGUF format model files for [INSAIT-Institute/BgGPT-Gemma-2-27B-IT-v1.0](https://huggingface.co/INSAIT-Institute/BgGPT-Gemma-2-27B-IT-v1.0).\n\n## Quick Start using Python\n\nInstall the required package:\n```bash\npip install llama-cpp-python\n```\n\nExample chat completion:\n\n```python\nfrom llama_cpp import Llama\n\nllm = Llama(\n    model_path=\"path/to/your/model.gguf\",\n    n_ctx=8192,\n    penalize_nl=False\n)\n\nmessages = [{\"role\": \"user\", \"content\": \"Кога е основан Софийският университет?\"}]\nresponse = llm.create_chat_completion(\n    messages=messages,\n    max_tokens=2048,        # Choose maximum generated tokens\n    temperature=0.1,\n    top_p=0.9,\n    repeat_penalty=1.0,\n    stop=[\"<eos>\", \"<end_of_turn>\"]\n)\n\n\n```\n\nExample normal completion:\n\n```python\nfrom llama_cpp import Llama\n\nllm = Llama(\n    model_path=\"path/to/your/model.gguf\",\n    n_ctx=8192,\n    penalize_nl=False\n)\n\nprompt = \"<start_of_turn>user\\nКога е основан Софийският университет?<end_of_turn>\\n<start_of_turn>model\\n\"\nresponse = llm(\n    prompt,\n    max_tokens=2048,        # Choose maximum generated tokens\n    temperature=0.1,\n    top_p=0.9,\n    repeat_penalty=1.0,\n    stop=[\"<eos>\",\"<end_of_turn>\"]\n)\n```",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "license:gemma",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 5,
  "downloads": 469,
  "gated": false,
  "private": false,
  "last_modified": "2024-11-19T08:21:47.000Z",
  "created_at": "2024-11-16T06:52:44.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "6738413c98b2d09abc9366cf",
  "id": "INSAIT-Institute/BgGPT-Gemma-2-27B-IT-v1.0-GGUF",
  "modelId": "INSAIT-Institute/BgGPT-Gemma-2-27B-IT-v1.0-GGUF",
  "sha": "983a96df1629b7f7b8cdad47124529e38651e46c",
  "createdAt": "2024-11-16T06:52:44.000Z",
  "lastModified": "2024-11-19T08:21:47.000Z",
  "author": "INSAIT-Institute",
  "downloads": 469,
  "likes": 5,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 12
}