richarderkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nnekomata-7b-pfn-qfin-inst-merge - GGUF\n- Model creator: https://huggingface.co/pfnet/\n- Original model: https://huggingface.co/pfnet/nekomata-7b-pfn-qfin-inst-merge/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [nekomata-7b-pfn-qfin-inst-merge.Q2_K.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q2_K.gguf) | Q2_K | 2.84GB |\n| [nekomata-7b-pfn-qfin-inst-merge.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.IQ3_XS.gguf) | IQ3_XS | 3.23GB |\n| [nekomata-7b-pfn-qfin-inst-merge.IQ3_S.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.IQ3_S.gguf) | IQ3_S | 3.32GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q3_K_S.gguf) | Q3_K_S | 3.32GB |\n| [nekomata-7b-pfn-qfin-inst-merge.IQ3_M.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.IQ3_M.gguf) | IQ3_M | 3.61GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q3_K.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q3_K.gguf) | Q3_K | 3.78GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q3_K_M.gguf) | Q3_K_M | 3.78GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q3_K_L.gguf) | Q3_K_L | 4.0GB |\n| [nekomata-7b-pfn-qfin-inst-merge.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.IQ4_XS.gguf) | IQ4_XS | 4.02GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q4_0.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q4_0.gguf) | Q4_0 | 4.2GB |\n| [nekomata-7b-pfn-qfin-inst-merge.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.IQ4_NL.gguf) | IQ4_NL | 4.22GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q4_K_S.gguf) | Q4_K_S | 4.22GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q4_K.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q4_K.gguf) | Q4_K | 4.56GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q4_K_M.gguf) | Q4_K_M | 4.56GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q4_1.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q4_1.gguf) | Q4_1 | 4.62GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q5_0.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q5_0.gguf) | Q5_0 | 5.03GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q5_K_S.gguf) | Q5_K_S | 5.03GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q5_K.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q5_K.gguf) | Q5_K | 5.32GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q5_K_M.gguf) | Q5_K_M | 5.32GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q5_1.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q5_1.gguf) | Q5_1 | 5.44GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q6_K.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q6_K.gguf) | Q6_K | 5.91GB |\n| [nekomata-7b-pfn-qfin-inst-merge.Q8_0.gguf](https://huggingface.co/RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf/blob/main/nekomata-7b-pfn-qfin-inst-merge.Q8_0.gguf) | Q8_0 | 7.65GB |\n\n\n\n\nOriginal model description:\n---\nlicense: other\nlicense_name: tongyi-qianwen-license\nlicense_link: LICENSE\nlanguage:\n- en\n- ja\nlibrary_name: transformers\npipeline_tag: text-generation\n---\n\n# nekomata-7b-pfn-qfin-inst-merge\n\n## Model Description\nnekomata-7b-pfn-qfin-inst-merge is a merged model using [rinna/nekomata-7b](https://huggingface.co/rinna/nekomata-7b/tree/main), [rinna/nekomata-7b-instruction](https://huggingface.co/rinna/nekomata-7b-instruction), and [pfnet/nekomata-7b-pfn-qfin](https://huggingface.co/pfnet/nekomata-7b-pfn-qfin).\nThis is the instruction model, which is good at generating answers for instructions.\nThis model is released under [Tongyi Qianwen LICENSE AGREEMENT](https://github.com/QwenLM/Qwen/blob/e8e15962d897714944773cca57fa2e460a3655e8/Tongyi%20Qianwen%20LICENSE%20AGREEMENT).\n\nYou should also see: [pfnet/nekomata-14b-pfn-qfin-inst-merge](https://huggingface.co/pfnet/nekomata-14b-pfn-qfin-inst-merge)\n\n## Usage\nInstall the required libraries as follows:\n```sh\n>>> python -m pip install numpy sentencepiece torch transformers accelerate transformers_stream_generator tiktoken einops\n```\n\nExecute the following python code:\n```python\nimport torch\nfrom transformers import AutoTokenizer, AutoModelForCausalLM\n\ntokenizer = AutoTokenizer.from_pretrained(\"pfnet/nekomata-7b-pfn-qfin-inst-merge\", trust_remote_code=True)\n\n# Use GPU with bf16 (recommended for supported devices)\n# model = AutoModelForCausalLM.from_pretrained(\"pfnet/nekomata-7b-pfn-qfin-inst-merge\", device_map=\"auto\", trust_remote_code=True, bf16=True)\n\n# Use GPU with fp16\n# model = AutoModelForCausalLM.from_pretrained(\"pfnet/nekomata-7b-pfn-qfin-inst-merge\", device_map=\"auto\", trust_remote_code=True, fp16=True)\n\n# Use GPU with fp32\n# model = AutoModelForCausalLM.from_pretrained(\"pfnet/nekomata-7b-pfn-qfin-inst-merge\", device_map=\"auto\", trust_remote_code=True, fp32=True)\n\n# Use CPU\n# model = AutoModelForCausalLM.from_pretrained(\"pfnet/nekomata-7b-pfn-qfin-inst-merge\", device_map=\"cpu\", trust_remote_code=True)\n\n# Automatically select device and precision\nmodel = AutoModelForCausalLM.from_pretrained(\"pfnet/nekomata-7b-pfn-qfin-inst-merge\", device_map=\"auto\", trust_remote_code=True)\n\ntext = \"\"\"以下は、タスクを説明する指示と、文脈のある入力の組み合わせです。要求を適切に満たす応答を書きなさい。\n\n### 指示:\n次の質問に答えてください。\n\n### 入力:\nデリバティブ取引のリスク管理について教えてください。\n\n### 応答:\"\"\"\ninput_ids = tokenizer(text, return_tensors=\"pt\").input_ids.to(model.device)\nwith torch.no_grad():\n  generated_tokens = model.generate(\n      inputs=input_ids,\n      max_new_tokens=512,\n      do_sample=False,\n      temperature=1.0,\n      repetition_penalty=1.1,\n      top_k=50,\n      pad_token_id=tokenizer.pad_token_id,\n      bos_token_id=tokenizer.bos_token_id,\n      eos_token_id=tokenizer.eos_token_id\n  )[0]\ngenerated_text = tokenizer.decode(generated_tokens)\nprint(generated_text.split(\"### 応答:\")[1])\n# デリバティブ取引では、原資産の価格変動が大きく影響します。そのため、リスク管理においては、原資産の価格変動リスクを適切にコントロールすることが重要となります。具体的には、ポジションサイズやレバレッジの制限、ヘッジ手法の活用などが挙げられます。また、市場情報の収集・分析を行い、適切なタイミングでポジションを調整することも大切です。さらに、取引先の信用リスクにも注意が必要であり、相手方の財務状況や信用度などを確認し、必要に応じて保証や担保を設定することが求められます。以上のようなリスク管理を行うことで、デリバティブ取引における損失リスクを最小化することができます。ただし、リスク管理はあくまで自己責任であるため、十分な知識と経験を持つことが望まれます。また、金融機関等の専門家によるアドバイスを受けることも有効です。以上が、デリバティブ取引におけるリスク管理の概要です。詳細については、金融庁や日本証券業協会などの公式サイトをご参照ください。\n```\n\n## Model Details\n- Model size: 7b\n- Context length: 2048\n- Developed by: Preferred Networks, Inc\n- Model type: Causal decoder-only\n- Language(s): Japanese and English\n- License: [Tongyi Qianwen LICENSE AGREEMENT](https://github.com/QwenLM/Qwen/blob/e8e15962d897714944773cca57fa2e460a3655e8/Tongyi%20Qianwen%20LICENSE%20AGREEMENT)\n\n## Bias, Risks, and Limitations\nnekomata-7b-pfn-qfin-inst-merge is a new technology that carries risks with use.\nTesting conducted to date has been in English and Japanese, and has not covered, nor could it cover all scenarios.\nFor these reasons, as with all LLMs, nekomata-7b-pfn-qfin-inst-merge’s potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate, biased or other objectionable responses to user prompts.\nThis model is not designed for legal, tax, investment, financial, or other advice.\nTherefore, before deploying any applications of nekomata-7b-pfn-qfin-inst-merge, developers should perform safety testing and tuning tailored to their specific applications of the model.\n\n## How to cite\nTBD\n\n## Contributors\nPreferred Networks, Inc.\n - Masanori Hirano\n - Kentaro Imajo\n\n# License\n[Tongyi Qianwen LICENSE AGREEMENT](https://github.com/QwenLM/Qwen/blob/e8e15962d897714944773cca57fa2e460a3655e8/Tongyi%20Qianwen%20LICENSE%20AGREEMENT)\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 0,
  "downloads": 250,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-21T01:23:13.000Z",
  "created_at": "2024-09-20T19:15:13.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66edc9c11f01aa6191514da0",
  "id": "RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf",
  "modelId": "RichardErkhov/pfnet_-_nekomata-7b-pfn-qfin-inst-merge-gguf",
  "sha": "60793683bcdf520fa1a96db415bae9a3a650c825",
  "createdAt": "2024-09-20T19:15:13.000Z",
  "lastModified": "2024-09-21T01:23:13.000Z",
  "author": "RichardErkhov",
  "downloads": 250,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}