richarderkhov/phanerozoic_-_tiny-knight-1.1b-v0.1-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "https://huggingface.co/phanerozoic/Tiny-Knight-1.1b-v0.1/resolve/bbfc665ce3af9d4d73e199b89144b30d668f50aa/tinyknight.png",
    "summary": "Tiny Knight-1.1b-v0.1 is a specialized language model crafted for generating knight and medieval-themed content. This iteration is built upon the foundations of TinyLlama-1.1B-Chat-v1.0, tailored to operate within environments constrained by computing resources. ### Performance While this model excels in creating knight-themed narratives, its specialization, however, limits its effectiveness in broader language tasks, especially those requiring detailed knowledge outside the medieval theme. ### Direct Use Tiny Knight-1.1b-v0.1 is particularly suited for generating content within medieval, knightly, or fantasy settings, ideal for storytelling, educational content, and thematic exploration. It is not recommended for general-purpose tasks or technical domains. ### Context Setting and Interaction Guidelines Given its specialized nature, Tiny Knight-1.1b-v0.1 benefits significantly from detailed context-setting. Providing a rich thematic backdrop in prompts enhances the model's performance, guiding it to generate more accurate and immersive content. ### Training Data Incorporates a dataset focused on knightly tales, medieval history, and literature, derived from the foundational TinyLlama-1.1B model. ### Custom Stopping Strings Custom stopping strings were used to refine output quality: ### Training Hyperparameters and Fine-Tuning Details ### Limitations While adept at producing themed content, Tiny Knight-1.1b-v0.1's applicability is limited outside its specialized domain of knights and medieval themes. ### Summary Tiny Knight-1.1b-v0.1 represents a significant advancement in thematic language models, offering a specialized tool for exploring the medieval era. Its emphasis on context for optimal performance and the use of custom stopping strings make it a sophisticated asset for generating historically rich content. ### Acknowledgments Special thanks to the TinyLlama-1.1B team, whose pioneering work laid the groundwork for the creation of Tiny Knight-1.1b-v0.1.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nTiny-Knight-1.1b-v0.1 - GGUF\n- Model creator: https://huggingface.co/phanerozoic/\n- Original model: https://huggingface.co/phanerozoic/Tiny-Knight-1.1b-v0.1/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [Tiny-Knight-1.1b-v0.1.Q2_K.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q2_K.gguf) | Q2_K | 0.4GB |\n| [Tiny-Knight-1.1b-v0.1.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.IQ3_XS.gguf) | IQ3_XS | 0.44GB |\n| [Tiny-Knight-1.1b-v0.1.IQ3_S.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.IQ3_S.gguf) | IQ3_S | 0.47GB |\n| [Tiny-Knight-1.1b-v0.1.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q3_K_S.gguf) | Q3_K_S | 0.47GB |\n| [Tiny-Knight-1.1b-v0.1.IQ3_M.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.IQ3_M.gguf) | IQ3_M | 0.48GB |\n| [Tiny-Knight-1.1b-v0.1.Q3_K.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q3_K.gguf) | Q3_K | 0.51GB |\n| [Tiny-Knight-1.1b-v0.1.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q3_K_M.gguf) | Q3_K_M | 0.51GB |\n| [Tiny-Knight-1.1b-v0.1.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q3_K_L.gguf) | Q3_K_L | 0.55GB |\n| [Tiny-Knight-1.1b-v0.1.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.IQ4_XS.gguf) | IQ4_XS | 0.57GB |\n| [Tiny-Knight-1.1b-v0.1.Q4_0.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q4_0.gguf) | Q4_0 | 0.59GB |\n| [Tiny-Knight-1.1b-v0.1.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.IQ4_NL.gguf) | IQ4_NL | 0.6GB |\n| [Tiny-Knight-1.1b-v0.1.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q4_K_S.gguf) | Q4_K_S | 0.6GB |\n| [Tiny-Knight-1.1b-v0.1.Q4_K.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q4_K.gguf) | Q4_K | 0.62GB |\n| [Tiny-Knight-1.1b-v0.1.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q4_K_M.gguf) | Q4_K_M | 0.62GB |\n| [Tiny-Knight-1.1b-v0.1.Q4_1.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q4_1.gguf) | Q4_1 | 0.65GB |\n| [Tiny-Knight-1.1b-v0.1.Q5_0.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q5_0.gguf) | Q5_0 | 0.71GB |\n| [Tiny-Knight-1.1b-v0.1.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q5_K_S.gguf) | Q5_K_S | 0.71GB |\n| [Tiny-Knight-1.1b-v0.1.Q5_K.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q5_K.gguf) | Q5_K | 0.73GB |\n| [Tiny-Knight-1.1b-v0.1.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q5_K_M.gguf) | Q5_K_M | 0.73GB |\n| [Tiny-Knight-1.1b-v0.1.Q5_1.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q5_1.gguf) | Q5_1 | 0.77GB |\n| [Tiny-Knight-1.1b-v0.1.Q6_K.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q6_K.gguf) | Q6_K | 0.84GB |\n| [Tiny-Knight-1.1b-v0.1.Q8_0.gguf](https://huggingface.co/RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf/blob/main/Tiny-Knight-1.1b-v0.1.Q8_0.gguf) | Q8_0 | 1.09GB |\n\n\n\n\nOriginal model description:\n---\nlicense: cc-by-nc-4.0\nlanguage:\n- en\nwidget:\n  - text: |\n      Hail and well met! Pray, what kind of food do ye enjoy supping upon?\n    example_title: \"The Code of Chivalry\"\n---\n![tinyknight.png](https://huggingface.co/phanerozoic/Tiny-Knight-1.1b-v0.1/resolve/bbfc665ce3af9d4d73e199b89144b30d668f50aa/tinyknight.png)\n# Tiny Knight-1.1b-v0.1\n\nTiny Knight-1.1b-v0.1 is a specialized language model crafted for generating knight and medieval-themed content. This iteration is built upon the foundations of TinyLlama-1.1B-Chat-v1.0, tailored to operate within environments constrained by computing resources.\n\n### Performance\nWhile this model excels in creating knight-themed narratives, its specialization, however, limits its effectiveness in broader language tasks, especially those requiring detailed knowledge outside the medieval theme.\n\n### Direct Use\nTiny Knight-1.1b-v0.1 is particularly suited for generating content within medieval, knightly, or fantasy settings, ideal for storytelling, educational content, and thematic exploration. It is not recommended for general-purpose tasks or technical domains.\n\n### Context Setting and Interaction Guidelines\nGiven its specialized nature, Tiny Knight-1.1b-v0.1 benefits significantly from detailed context-setting. Providing a rich thematic backdrop in prompts enhances the model's performance, guiding it to generate more accurate and immersive content.\n\n### Training Data\nIncorporates a dataset focused on knightly tales, medieval history, and literature, derived from the foundational TinyLlama-1.1B model.\n\n### Custom Stopping Strings\nCustom stopping strings were used to refine output quality:\n\n- \"},\"\n- \"User:\"\n- \"You:\"\n- \"\\nUser\"\n- \"\\nUser:\"\n- \"me:\"\n- \"user\"\n- \"\\n\"\n\n### Training Hyperparameters and Fine-Tuning Details\n- **Base Model Name**: TinyLlama-1.1B-Chat-v1.0\n- **Base Model Class**: LlamaForCausalLM\n- **Projections**: gate, down, up, q, k, v, o\n- **LoRA Rank**: 16\n- **LoRA Alpha**: 32\n- **True Batch Size**: 32\n- **Gradient Accumulation Steps**: 1\n- **Epochs**: 0.18\n- **Learning Rate**: 3e-4\n- **LR Scheduler**: Linear\n- **Step**: 75\n- **Loss**: 1.87\n\n### Limitations\nWhile adept at producing themed content, Tiny Knight-1.1b-v0.1's applicability is limited outside its specialized domain of knights and medieval themes.\n\n### Summary\nTiny Knight-1.1b-v0.1 represents a significant advancement in thematic language models, offering a specialized tool for exploring the medieval era. Its emphasis on context for optimal performance and the use of custom stopping strings make it a sophisticated asset for generating historically rich content.\n\n### Acknowledgments\nSpecial thanks to the TinyLlama-1.1B team, whose pioneering work laid the groundwork for the creation of Tiny Knight-1.1b-v0.1.\n\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 91,
  "gated": false,
  "private": false,
  "last_modified": "2024-07-03T03:04:53.000Z",
  "created_at": "2024-07-03T02:56:57.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "6684bdf96b4de82b9e32d724",
  "id": "RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf",
  "modelId": "RichardErkhov/phanerozoic_-_Tiny-Knight-1.1b-v0.1-gguf",
  "sha": "8f7399dfd44e7bae07e1997f71ed8736cac66db7",
  "createdAt": "2024-07-03T02:56:57.000Z",
  "lastModified": "2024-07-03T03:04:53.000Z",
  "author": "RichardErkhov",
  "downloads": 91,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}