richarderkhov/leroydyer_-_spydazweb_ai_cybertron_ultra_7b-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "https://cdn-avatars.huggingface.co/v1/production/uploads/65d883893a52cd9bcd8ab7cf/tRsCJlHNZo1D02kBTmfy9.jpeg",
    "summary": "[ https://github.com/spydaz * The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2. * Mistral-7B-v0.2 has the following changes compared to Mistral-7B-v0.1 * 32k context window (vs 8k context in v0.1) * Rope-theta = 1e6 * No Sliding-Window Attention # What does he NOT KNOW ! that is the question! ### MOTTO FOR MODEL!",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nSpydazWeb_AI_CyberTron_Ultra_7b - GGUF\n- Model creator: https://huggingface.co/LeroyDyer/\n- Original model: https://huggingface.co/LeroyDyer/SpydazWeb_AI_CyberTron_Ultra_7b/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q2_K.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q2_K.gguf) | Q2_K | 2.53GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.IQ3_XS.gguf) | IQ3_XS | 2.81GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.IQ3_S.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.IQ3_S.gguf) | IQ3_S | 2.96GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q3_K_S.gguf) | Q3_K_S | 2.95GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.IQ3_M.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.IQ3_M.gguf) | IQ3_M | 3.06GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q3_K.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q3_K.gguf) | Q3_K | 3.28GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q3_K_M.gguf) | Q3_K_M | 3.28GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q3_K_L.gguf) | Q3_K_L | 3.56GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.IQ4_XS.gguf) | IQ4_XS | 3.67GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q4_0.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q4_0.gguf) | Q4_0 | 3.83GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.IQ4_NL.gguf) | IQ4_NL | 3.87GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q4_K_S.gguf) | Q4_K_S | 3.86GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q4_K.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q4_K.gguf) | Q4_K | 4.07GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q4_K_M.gguf) | Q4_K_M | 4.07GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q4_1.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q4_1.gguf) | Q4_1 | 4.24GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q5_0.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q5_0.gguf) | Q5_0 | 4.65GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q5_K_S.gguf) | Q5_K_S | 4.65GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q5_K.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q5_K.gguf) | Q5_K | 4.78GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q5_K_M.gguf) | Q5_K_M | 4.78GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q5_1.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q5_1.gguf) | Q5_1 | 5.07GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q6_K.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q6_K.gguf) | Q6_K | 5.53GB |\n| [SpydazWeb_AI_CyberTron_Ultra_7b.Q8_0.gguf](https://huggingface.co/RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf/blob/main/SpydazWeb_AI_CyberTron_Ultra_7b.Q8_0.gguf) | Q8_0 | 7.17GB |\n\n\n\n\nOriginal model description:\n---\nlanguage:\n- en\nlicense: apache-2.0\ntags:\n- text-generation-inference\n- transformers\n- unsloth\n- mistral\n- trl\n- code\n- 'medical '\n- farmer\n- doctor\n- Mega-Series\n- Cyber-Series\n- Role-Play\n- Self-Rag\n- ThinkingBot\n- milestone\n- mega-series\n- SpydazWebAI\nbase_model: LeroyDyer/Mixtral_AI_CyberTron_Ultra\nmetrics:\n- accuracy\n- bertscore\n- bleu\n- brier_score\n- cer\n- character\n- charcut_mt\n- chrf\n- code_eval\nlibrary_name: transformers\ndatasets:\n- gretelai/synthetic_text_to_sql\n- HuggingFaceTB/cosmopedia\n- teknium/OpenHermes-2.5\n- Open-Orca/SlimOrca\n- Open-Orca/OpenOrca\n- cognitivecomputations/dolphin-coder\n- databricks/databricks-dolly-15k\n- yahma/alpaca-cleaned\n- uonlp/CulturaX\n- mwitiderrick/SwahiliPlatypus\n- swahili\n- Rogendo/English-Swahili-Sentence-Pairs\n- ise-uiuc/Magicoder-Evol-Instruct-110K\n- meta-math/MetaMathQA\n---\n\n# Uploaded  model\n\n- **Developed by:** LeroyDyer\n- **License:** apache-2.0\n- **Finetuned from model :** LeroyDyer/Mixtral_AI_CyberTron_Ultra\n\n[<img src=\"https://cdn-avatars.huggingface.co/v1/production/uploads/65d883893a52cd9bcd8ab7cf/tRsCJlHNZo1D02kBTmfy9.jpeg\" width=\"300\"/>\nhttps://github.com/spydaz\n\n\n* The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.\n\n* Mistral-7B-v0.2 has the following changes compared to Mistral-7B-v0.1\n\n    * 32k context window (vs 8k context in v0.1)\n    * Rope-theta = 1e6\n    * No Sliding-Window Attention\n\n\n# What does he NOT KNOW ! that is the question!\n\n### MOTTO FOR MODEL!\n\n## Models are the same as loras , take them with light weight they are like tablets of knowledge!  \nExactly ! ( models / loras ? is there a difference ? only mega merges make a true difference ! \n                      the small merges are just applying an adapter lol - Its in there somewhere?) \n\n### Ok Its a Great MODEL ! (My Favorite Goto Brain now ! - will be fine tuned even more ! (if i get cloud credits)) \n\n\n\nHighly Math Trained As well as many TextBooks and Lessons Highly fit datasets  as well as Coding Datasets highly tuned! \n\nThis model has absorbed all its previous generations as well as ALL high performers and Specialist models (mistral) It has absorb many foriegn languge models and still stays as an english model !\n\nVery impressive responses Short and long as also it was trained on some binary datasets to return a direct answer! and others to perform step by step response as wel as other to perform interactive response with clients for vairous tasks, such as product design and system design discussion:\n\nFinacial information and other finacial tasks have been highly tunes also : Infact when returning to previous aligned datasets they stayed in line and was sdtill able to achieve High tuning!\nHence a process of merging with a specific topic or role and then training for the role and topic on themed data, hence previous itterations heavily tuned for medical or law or role play as the conception was that intergating the model into a single enity may even corrput them , so the decision to seperate concerns was taken :\nThis enabled for ssstrategic merging and tuning !\n\nConcepts : chain of thought and functin calling Self rag ! Thoughts , emotive responses have been enhance where possibel with the data given . even sexy books have been highly tuned into the model : \nbut also i think american genera books (sci fi, fantasy, romance novels are required) for great role play which some expect: )\nI have recently seen a strategy in which prompts can be embedded into the adapter to Trigger Specific Roles : \nI hae tried to remove such prompting as you are a helpful ai to a character theme instead such as you are a cyber hacker by day and business man by night ! ie to give the model various internal personas !\nafter some training i noticed it was also talking to itself !! (rehersing) but the tokens for thought were missing so it lookeed strange until i noticed the bug; \nAfter removing the thought tokens they were displayed in the output as the tokenizer was masking them !\n\nBut Still a Great Model , Given a Task based data set it Coverges Super quickly hence my enjoyment of the model as training of it is super quick !\nNow when ii load up datasets : they are generally only a few bad steps before it begins to drop below zero maintaining a steady 0.6 etc whilst loading the unnseen new dataset , hence not needing so many epochs to adjust the matrix to the new information !\n\nIm not sure if Lora actually works when you save them but i do save some and use them to load models for training ! as they are jump starts for model which did not recive that fine tuning , they can be merged and alligned ! (probably thiey are Good! )\n\n\n\n\n\n\n\n\n\n\n\n\n\nThis mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.\n\n[<img src=\"https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png\" width=\"200\"/>](https://github.com/unslothai/unsloth)\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 115,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-21T00:03:51.000Z",
  "created_at": "2024-09-20T20:34:15.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66eddc47aa392dc14e82f41b",
  "id": "RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf",
  "modelId": "RichardErkhov/LeroyDyer_-_SpydazWeb_AI_CyberTron_Ultra_7b-gguf",
  "sha": "f748a1e08ad512e0d63903f26cb29e81caf5b096",
  "createdAt": "2024-09-20T20:34:15.000Z",
  "lastModified": "2024-09-21T00:03:51.000Z",
  "author": "RichardErkhov",
  "downloads": 115,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}