quantfactory/turkish-llama-8b-v0.1-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "llama3",
    "language": [
      "tr"
    ],
    "pipeline_tag": "text-generation",
    "base_model": "ytu-ce-cosmos/Turkish-Llama-8b-v0.1",
    "tags": [
      "Turkish",
      "turkish",
      "Llama",
      "Llama3"
    ],
    "library_name": "transformers",
    "frontmatter": {
      "license": "llama3",
      "language": [
        "tr"
      ],
      "pipeline_tag": "text-generation",
      "base_model": "ytu-ce-cosmos/Turkish-Llama-8b-v0.1",
      "tags": [
        "Turkish",
        "turkish",
        "Llama",
        "Llama3"
      ],
      "library_name": "transformers"
    },
    "hero_image_url": "",
    "summary": "This model is a fully fine-tuned version of the LLaMA-3 8B model with a 30GB Turkish dataset. The Cosmos LLaMa is designed for text generation tasks, providing the ability to continue a given text snippet in a coherent and contextually relevant manner. Due to the diverse nature of the training data, which includes websites, books, and other text sources, this model can exhibit biases. Users should be aware of these biases and use the model responsibly.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: llama3\nlanguage:\n- tr\npipeline_tag: text-generation\nbase_model: ytu-ce-cosmos/Turkish-Llama-8b-v0.1\ntags:\n- Turkish\n- turkish\n- Llama\n- Llama3\nlibrary_name: transformers\n---\n# Turkish-Llama-8b-v0.1-GGUF\nThis is quantized version of [ytu-ce-cosmos/Turkish-Llama-8b-v0.1](https://huggingface.co/ytu-ce-cosmos/Turkish-Llama-8b-v0.1) created using llama.cpp\n\n# Cosmos LLaMa\n\nThis model is a fully fine-tuned version of the LLaMA-3 8B model with a 30GB Turkish dataset.\n\nThe Cosmos LLaMa is designed for text generation tasks, providing the ability to continue a given text snippet in a coherent and contextually relevant manner. Due to the diverse nature of the training data, which includes websites, books, and other text sources, this model can exhibit biases. Users should be aware of these biases and use the model responsibly.\n\n## Example Usage\n\nHere is an example of how to use the model in colab:\n\n```python\n!pip install -U accelerate bitsandbytes\n```\n\n```python\nimport torch\nfrom transformers import pipeline, AutoTokenizer, AutoModelForCausalLM\nfrom transformers import BitsAndBytesConfig\nimport time\n\nmodel_name = \"ytu-ce-cosmos/Turkish-Llama-8b-v0.1\"\n\nbnb_config = BitsAndBytesConfig(\n    load_in_8bit=True,\n    bnb_8bit_compute_dtype=torch.bfloat16,\n    load_in_8bit_fp32_cpu_offload=True,\n    device_map = 'auto'\n)\n\ntokenizer = AutoTokenizer.from_pretrained(model_name)\nmodel = AutoModelForCausalLM.from_pretrained(\n    model_name,\n    device_map=\"auto\",\n    torch_dtype=torch.bfloat16,\n    quantization_config=bnb_config,\n)\n```\n\n```python\ntext_generator = pipeline(\n    \"text-generation\",\n    model=model,\n    tokenizer=tokenizer,\n    device_map=\"auto\",\n    temperature=0.3,\n    repetition_penalty=1.1,\n    top_p=0.9,\n    max_length=610,\n    do_sample=True,\n    return_full_text=False,\n    min_new_tokens=32\n)\n```\n\n```python\ntext = \"\"\"Yapay zeka hakkında 3 tespit yaz.\\n\"\"\"\n\nr = text_generator(text)\n\nprint(r[0]['generated_text'])\n\n\"\"\"\n1. Yapay Zeka (AI), makinelerin insan benzeri bilişsel işlevleri gerçekleştirmesini sağlayan bir teknoloji alanıdır.\n\n2. Yapay zekanın geliştirilmesi ve uygulanması, sağlık hizmetlerinden eğlenceye kadar çeşitli sektörlerde çok sayıda fırsat sunmaktadır.\n\n3. Yapay zeka teknolojisinin potansiyel faydaları önemli olsa da mahremiyet, işten çıkarma ve etik hususlar gibi konularla ilgili endişeler de var.\n\"\"\"\n```\n\n# Acknowledgments\n- Thanks to the generous support from the Hugging Face team, it is possible to download models from their S3 storage 🤗\n- Computing resources used in this work were provided by the National Center for High Performance Computing of Turkey (UHeM) under grant numbers 1016912023 and \n1018512024\n- Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC)\n\n### Cosmos Group Contact\nCOSMOS AI Research Group, Yildiz Technical University Computer Engineering Department <br>\nhttps://cosmos.yildiz.edu.tr/ <br>\ncosmos@yildiz.edu.tr\n\n\n---\nlicense: llama3\n---",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "Turkish",
    "turkish",
    "Llama",
    "Llama3",
    "text-generation",
    "tr",
    "base_model:ytu-ce-cosmos/Turkish-Llama-8b-v0.1",
    "base_model:quantized:ytu-ce-cosmos/Turkish-Llama-8b-v0.1",
    "license:llama3",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 4,
  "downloads": 157,
  "gated": false,
  "private": false,
  "last_modified": "2024-05-27T09:25:17.000Z",
  "created_at": "2024-05-27T08:01:21.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}

{
  "_id": "66543dd183fac8ccdc247dcf",
  "id": "QuantFactory/Turkish-Llama-8b-v0.1-GGUF",
  "modelId": "QuantFactory/Turkish-Llama-8b-v0.1-GGUF",
  "sha": "9a7c626d7715fdecb8c773f0c5e7448e2c6ac1c3",
  "createdAt": "2024-05-27T08:01:21.000Z",
  "lastModified": "2024-05-27T09:25:17.000Z",
  "author": "QuantFactory",
  "downloads": 157,
  "likes": 4,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 16
}