richarderkhov/dbands_-_qwen2-7b-instruct-ifrs-accountant-16b-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png",
    "summary": "This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nQwen2-7B-Instruct-IFRS-Accountant-16B - GGUF\n- Model creator: https://huggingface.co/dbands/\n- Original model: https://huggingface.co/dbands/Qwen2-7B-Instruct-IFRS-Accountant-16B/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q2_K.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q2_K.gguf) | Q2_K | 2.81GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ3_XS.gguf) | IQ3_XS | 3.12GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ3_S.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ3_S.gguf) | IQ3_S | 3.26GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q3_K_S.gguf) | Q3_K_S | 3.25GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ3_M.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ3_M.gguf) | IQ3_M | 3.33GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q3_K.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q3_K.gguf) | Q3_K | 3.55GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q3_K_M.gguf) | Q3_K_M | 3.55GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q3_K_L.gguf) | Q3_K_L | 3.81GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ4_XS.gguf) | IQ4_XS | 3.96GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_0.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_0.gguf) | Q4_0 | 4.13GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.IQ4_NL.gguf) | IQ4_NL | 4.16GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_K_S.gguf) | Q4_K_S | 4.15GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_K.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_K.gguf) | Q4_K | 4.36GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_K_M.gguf) | Q4_K_M | 4.36GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_1.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q4_1.gguf) | Q4_1 | 4.54GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_0.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_0.gguf) | Q5_0 | 4.95GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_K_S.gguf) | Q5_K_S | 4.95GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_K.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_K.gguf) | Q5_K | 5.07GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_K_M.gguf) | Q5_K_M | 5.07GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_1.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q5_1.gguf) | Q5_1 | 5.36GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q6_K.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q6_K.gguf) | Q6_K | 5.82GB |\n| [Qwen2-7B-Instruct-IFRS-Accountant-16B.Q8_0.gguf](https://huggingface.co/RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf/blob/main/Qwen2-7B-Instruct-IFRS-Accountant-16B.Q8_0.gguf) | Q8_0 | 7.54GB |\n\n\n\n\nOriginal model description:\n---\nbase_model:\n- dbands/Qwen2-7B-Instruct-IFRS-Accountant-16B\nlanguage:\n- en\nlicense: apache-2.0\ntags:\n- text-generation-inference\n- transformers\n- unsloth\n- qwen2\n- trl\n- accounting\n---\n\nThe model is a work in progress it is inteneded to be used as a base model to enable the automation of agents that need to work in an accounting environment where work is provided in the form of complex problems and decisions need to be made for the purpose of posting into a GL given the double entry system as well as IFRS.  I did not train this model up on GAAP, I might for a future use case do so.\n\nThis model is highly experimental and is most definately not to be considered production ready.  I will throw more resources at this model as time goes by.\n\nIn my view it does pretty well.\n\nWhen prompting the model add in the context of the model \"How must this be treated from accounting perspective: <add instruction>\"\n\nI used a self curated chain of thought so it would be good to in the comments on the model indicate where the model might not be technically correct in its responses or where it went off script, same as \"logging a ticket\", I will look at the instances and enhance the training set so that the model becomes more accurate and usefull over time.\n\nPlease remember this model is part of an experiment and can not be considered production ready, use at your own risk if you decide to deploy in environment where output would be used to inform decisions.\n\n\n# Uploaded  model\n\n- **Developed by:** dbands\n- **License:** apache-2.0\n- **Finetuned from model :** dbands/Qwen2-7B-Instruct-IFRS-Accountant-16B\n\nThis qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.\n\n[<img src=\"https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png\" width=\"200\"/>](https://github.com/unslothai/unsloth)\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 2,
  "downloads": 92,
  "gated": false,
  "private": false,
  "last_modified": "2024-10-19T04:35:50.000Z",
  "created_at": "2024-10-19T01:05:19.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "671305cfa52fddaf960f59bc",
  "id": "RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf",
  "modelId": "RichardErkhov/dbands_-_Qwen2-7B-Instruct-IFRS-Accountant-16B-gguf",
  "sha": "9007fa1128618b655f72a7ae07cf6d656170de04",
  "createdAt": "2024-10-19T01:05:19.000Z",
  "lastModified": "2024-10-19T04:35:50.000Z",
  "author": "RichardErkhov",
  "downloads": 92,
  "likes": 2,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}