richarderkhov/sujet-ai_-_sujet-finance-8b-v0.1-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "7b.jpg",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nSujet-Finance-8B-v0.1 - GGUF\n- Model creator: https://huggingface.co/sujet-ai/\n- Original model: https://huggingface.co/sujet-ai/Sujet-Finance-8B-v0.1/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [Sujet-Finance-8B-v0.1.Q2_K.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q2_K.gguf) | Q2_K | 2.96GB |\n| [Sujet-Finance-8B-v0.1.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.IQ3_XS.gguf) | IQ3_XS | 3.28GB |\n| [Sujet-Finance-8B-v0.1.IQ3_S.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.IQ3_S.gguf) | IQ3_S | 3.43GB |\n| [Sujet-Finance-8B-v0.1.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q3_K_S.gguf) | Q3_K_S | 3.41GB |\n| [Sujet-Finance-8B-v0.1.IQ3_M.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.IQ3_M.gguf) | IQ3_M | 3.52GB |\n| [Sujet-Finance-8B-v0.1.Q3_K.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q3_K.gguf) | Q3_K | 3.74GB |\n| [Sujet-Finance-8B-v0.1.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q3_K_M.gguf) | Q3_K_M | 3.74GB |\n| [Sujet-Finance-8B-v0.1.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q3_K_L.gguf) | Q3_K_L | 4.03GB |\n| [Sujet-Finance-8B-v0.1.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.IQ4_XS.gguf) | IQ4_XS | 4.18GB |\n| [Sujet-Finance-8B-v0.1.Q4_0.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q4_0.gguf) | Q4_0 | 4.34GB |\n| [Sujet-Finance-8B-v0.1.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.IQ4_NL.gguf) | IQ4_NL | 4.38GB |\n| [Sujet-Finance-8B-v0.1.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q4_K_S.gguf) | Q4_K_S | 4.37GB |\n| [Sujet-Finance-8B-v0.1.Q4_K.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q4_K.gguf) | Q4_K | 4.58GB |\n| [Sujet-Finance-8B-v0.1.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q4_K_M.gguf) | Q4_K_M | 4.58GB |\n| [Sujet-Finance-8B-v0.1.Q4_1.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q4_1.gguf) | Q4_1 | 4.78GB |\n| [Sujet-Finance-8B-v0.1.Q5_0.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q5_0.gguf) | Q5_0 | 5.21GB |\n| [Sujet-Finance-8B-v0.1.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q5_K_S.gguf) | Q5_K_S | 5.21GB |\n| [Sujet-Finance-8B-v0.1.Q5_K.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q5_K.gguf) | Q5_K | 5.34GB |\n| [Sujet-Finance-8B-v0.1.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q5_K_M.gguf) | Q5_K_M | 5.34GB |\n| [Sujet-Finance-8B-v0.1.Q5_1.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q5_1.gguf) | Q5_1 | 5.65GB |\n| [Sujet-Finance-8B-v0.1.Q6_K.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q6_K.gguf) | Q6_K | 6.14GB |\n| [Sujet-Finance-8B-v0.1.Q8_0.gguf](https://huggingface.co/RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf/blob/main/Sujet-Finance-8B-v0.1.Q8_0.gguf) | Q8_0 | 7.95GB |\n\n\n\n\nOriginal model description:\n---\nlicense: apache-2.0\ndatasets:\n- sujet-ai/Sujet-Finance-Instruct-177k\nlanguage:\n- en\nmetrics:\n- accuracy\npipeline_tag: text-generation\ntags:\n- finance\n- topic classification\n- sentiment analysis\n- qa\n---\n<Gallery />\n\n# Introducing Sujet Finance 8B v0.1 🚀\n\n## A Specialized Financial Language Model Fine-Tuned on Sujet Finance Instruct-177k Dataset\n\n\n<img src=\"7b.jpg\" width=\"400\" height=\"200\">\n\nWelcome to the exciting world of **Sujet Finance 8B v0.1** – your go-to language model for all things finance! 💰 This state-of-the-art model is a fine-tuned version of the powerful LLAMA 3 model, meticulously trained on the comprehensive Sujet Finance Instruct-177k dataset. 📈\n\n### 🎯 Fine-Tuning Focus\n\nIn this initial fine-tuning iteration, we've focused on three key financial tasks:\n\n1. ✅❌ Yes/No Questions\n   - Description: This task involves answering financial questions that require a simple \"yes\" or \"no\" response.\n   - Class Distribution:\n     - Train Set: 5,265 \"yes\" examples, 5,302 \"no\" examples\n     - Eval Set: 1,340 \"yes\" examples, 1,303 \"no\" examples\n\n2. 📂 Topic Classification\n   - Description: The model classifies financial texts into specific finance-related categories such as company news, markets, earnings, and more.\n   - Class Distribution:\n     - Train Set: Balanced across 20 classes, with 29-40 examples per class\n     - Eval Set: Varies across classes, ranging from 4 to 15 examples per class\n\n3. 😊😐😡 Sentiment Analysis\n   - Description: This task involves analyzing financial texts to categorize sentiments as positive, negative, neutral, bearish, or bullish.\n   - Class Distribution:\n     - Train Set: 1,160 positive, 1,155 negative, 1,150 neutral, 1,133 bearish, and 1,185 bullish examples\n     - Eval Set: 281 positive, 286 negative, 291 neutral, 308 bearish, and 256 bullish examples\n\n\n\n### Inference code\n\n**This model was finetuned using Unsloth. Please refer to their github repository and make sure you have it installed before using the model : [Unsloth](https://github.com/unslothai/unsloth)**\n\n```python\nfrom unsloth import FastLanguageModel\n\n\nmax_seq_length = 2048 \ndtype = None \nload_in_4bit = False \n\n\nalpaca_prompt = \"\"\"Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n\n### Instruction:\n{}\n\n### Input:\n{}\n\n### Response:\n{}\"\"\"\n\n\nmodel, tokenizer = FastLanguageModel.from_pretrained(\n    model_name = \"sujet-ai/Sujet-Finance-8B-v0.1\",\n    max_seq_length = max_seq_length,\n    dtype = dtype,\n    load_in_4bit = load_in_4bit,\n    token = \"your hf token here\",\n)\n\n\nexample = {\n'system_prompt': 'You are a financial sentiment analysis expert. Your task is to analyze the sentiment expressed in the given financial text.Only reply with bearish, neutral, or bullish.',\n'user_prompt': \"Expedia's Problems Run Deeper Than SEO Headwinds\",\n'answer': 'bearish',\n}\n\n\ninputs = tokenizer(\n                [alpaca_prompt.format(\n                    example['system_prompt'],  # instruction\n                    example['user_prompt'],  # input\n                    \"\",  # output - leave this blank for generation!\n                )],\n                return_tensors=\"pt\"\n            ).to(\"cuda\")\n            \noutputs = model.generate(**inputs, max_new_tokens=2048, use_cache=True, pad_token_id=tokenizer.eos_token_id)\noutput = tokenizer.batch_decode(outputs)[0]\nresponse = output.split(\"### Response:\")[1].strip()\nprint(response)\n```\n\n**You can find more information about the dataset by clicking on this link : [Sujet-Finance-Instruct-177k Dataset](https://huggingface.co/datasets/sujet-ai/Sujet-Finance-Instruct-177k)**\n\nOur model has been carefully trained to excel in these areas, providing accurate and insightful responses to your financial queries. 💡\n\n### 🎓 Training Methodology\n\nTo ensure optimal performance, we've employed a balanced training approach. Our dataset preparation process strategically selects an equal number of examples from each subclass within the three focus tasks. This results in a well-rounded model that can handle a diverse range of financial questions and topics. 🧠\n\nThe final balanced training dataset consists of 17,036 examples, while the evaluation dataset contains 4,259 examples.\n\n### 🔧 Model Specifications\n\n- Base Model: LLAMA 3 8B 🦙\n- Fine-Tuning Technique: LoRA (Low-Rank Adaptation)\n  - r = 16\n  - alpha = 32\n- Learning Rate: 2e-4 📈\n- Weight Decay: 0.01 🏋️‍♂️\n- Epochs: 1 🔄\n- Quantization: float16 for VLLM 🗜️\n\n### 📊 Evaluation Results\n\nWe've put our model to the test, comparing its performance against the base LLAMA 3 model on our evaluation dataset. The results are impressive! 🏆\n\nWe consider a response correct if the true answer appears within the first 10 words generated by the model. This strict criterion ensures that our model not only provides accurate answers but also prioritizes the most relevant information. 🎯\n\n<img src=\"eval.jpg\" width=\"400\" height=\"200\">\n\n\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 0,
  "downloads": 5146,
  "gated": false,
  "private": false,
  "last_modified": "2024-08-19T13:47:36.000Z",
  "created_at": "2024-08-19T11:59:49.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66c333b5a9425c872d7a814d",
  "id": "RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf",
  "modelId": "RichardErkhov/sujet-ai_-_Sujet-Finance-8B-v0.1-gguf",
  "sha": "c7e2b2523145248297e25beb1e0ee60fcf4a8ca6",
  "createdAt": "2024-08-19T11:59:49.000Z",
  "lastModified": "2024-08-19T13:47:36.000Z",
  "author": "RichardErkhov",
  "downloads": 5146,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}