quantfactory/mistral-nemo-12b-arliai-rpmax-v1.1-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "frontmatter": {},
    "hero_image_url": "https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ",
    "summary": "This is quantized version of ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1 created using llama.cpp # Original Model Card # ArliAI-RPMax-12B-v1.1 =====================================",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "\n---\n\nlicense: apache-2.0\n\n---\n\n![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)\n\n# QuantFactory/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF\nThis is quantized version of [ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1](https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1) created using llama.cpp\n\n# Original Model Card\n\n# ArliAI-RPMax-12B-v1.1\n=====================================\n\n## Overview\n\nThis repository is based on the Mistral-Nemo-Base-2407 model and is governed by the Apache 2.0 License agreement: https://huggingface.co/mistralai/Mistral-Nemo-Base-2407\n\n## Model Description\n\nArliAI-RPMax-12B-v1.1 is trained on a diverse set of curated RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive, with a unique approach to training that minimizes repetition.\n\nYou can access the model at https://arliai.com and ask questions at https://www.reddit.com/r/ArliAI/\n\n### Training Details\n\n* **Sequence Length**: 8192\n* **Training Duration**: Approximately 2 days on 2x3090Ti\n* **Epochs**: 1 epoch training for minimized repetition sickness\n* **QLORA**: 64-rank 128-alpha, resulting in ~2% trainable weights\n* **Learning Rate**: 0.00001\n* **Gradient accumulation**: Very low 32 for better learning.\n\n## Quantization\n\nThe model is available in quantized formats:\n\n* **FP16**: https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1\n* **GPTQ_Q4**: https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GPTQ_Q4\n* **GPTQ_Q8**: https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GPTQ_Q8\n* **GGUF**: https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF\n\n\n## Suggested Prompt Format\n\nMistral Instruct Prompt Format\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 3,
  "downloads": 103,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-09T06:58:29.000Z",
  "created_at": "2024-09-09T05:44:56.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66de8b585598833ba1b08ff6",
  "id": "QuantFactory/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF",
  "modelId": "QuantFactory/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF",
  "sha": "83a31e7161874f6c2b94fd8b02a8d0d49a9f7f6b",
  "createdAt": "2024-09-09T05:44:56.000Z",
  "lastModified": "2024-09-09T06:58:29.000Z",
  "author": "QuantFactory",
  "downloads": 103,
  "likes": 3,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 16
}