GraySoft
Projects Models About FAQ Contact Download guIDE →

mmnga/pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf IQ2_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

mmnga/pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf overview

pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf pfnetさんが公開しているnekomata-14b-pfn-qfin-inst-mergeのggufフォーマット変換版です。 imatrixのデータはTFMC/imatrix-dataset-for-japanese-llmを使用して作成しました。

ggufqwenenjadataset:TFMC/imatrix-dataset-for-japanese-llmlicense:otherendpoints_compatibleregion:us
mmnga/pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf visual
Downloads
205
Likes
0
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

24 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ1_M.gguf GGUF IQ1_M 4.25 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ1_S.gguf GGUF IQ1_S 4.06 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ2_M.gguf GGUF IQ2_M 5.32 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ2_S.gguf GGUF IQ2_S 5.07 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ2_XS.gguf GGUF IQ2_XS 4.85 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ2_XXS.gguf GGUF IQ2_XXS 4.57 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ3_M.gguf GGUF IQ3_M 6.87 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ3_S.gguf GGUF IQ3_S 6.31 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ3_XS.gguf GGUF IQ3_XS 6.12 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ3_XXS.gguf GGUF IQ3_XXS 5.83 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ4_NL.gguf GGUF IQ4_NL 7.62 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-IQ4_XS.gguf GGUF IQ4_XS 7.31 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q2_K.gguf GGUF Q2_K 5.41 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q3_K_L.gguf GGUF Q3_K_L 7.44 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q3_K_M.gguf GGUF Q3_K_M 7.16 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q3_K_S.gguf GGUF Q3_K_S 6.31 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q4_0.gguf GGUF 7.62 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q4_K_M.gguf GGUF Q4_K_M 8.80 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q4_K_S.gguf GGUF Q4_K_S 7.96 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q5_0.gguf GGUF 9.18 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q5_K_M.gguf GGUF Q5_K_M 10.14 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q5_K_S.gguf GGUF Q5_K_S 9.34 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q6_K.gguf GGUF Q6_K 11.46 GB Download
pfnet-nekomata-14b-pfn-qfin-inst-merge-Q8_0.gguf GGUF 14.03 GB Download

Model Details Live

Model Slug
mmnga/pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf
Author
mmnga
Pipeline Task
Library
Created
2024-04-23
Last Modified
2024-04-24
Gated
No
Private
No
HF SHA
8442313f5f26318ff836f1dbc5a68b7184ab166f
License
other
Language
en, ja
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "other",
    "license_name": "tongyi-qianwen",
    "license_link": "https://huggingface.co/pfnet/nekomata-14b-pfn-qfin-inst-merge/blob/main/LICENSE",
    "language": [
      "en",
      "ja"
    ],
    "tags": [
      "qwen"
    ],
    "datasets": [
      "TFMC/imatrix-dataset-for-japanese-llm"
    ],
    "frontmatter": {
      "license": "other",
      "license_name": "tongyi-qianwen",
      "license_link": ">-",
      "language": [
        "en",
        "ja"
      ],
      "tags": [
        "qwen"
      ],
      "datasets": [
        "TFMC/imatrix-dataset-for-japanese-llm"
      ]
    },
    "hero_image_url": "",
    "summary": "# pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf pfnetさんが公開しているnekomata-14b-pfn-qfin-inst-mergeのggufフォーマット変換版です。 imatrixのデータはTFMC/imatrix-dataset-for-japanese-llmを使用して作成しました。",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: other\nlicense_name: tongyi-qianwen\nlicense_link: >-\n  https://huggingface.co/pfnet/nekomata-14b-pfn-qfin-inst-merge/blob/main/LICENSE\nlanguage:\n- en\n- ja\ntags:\n- qwen\ndatasets:\n- TFMC/imatrix-dataset-for-japanese-llm\n---\n# pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf \n[pfnetさんが公開しているnekomata-14b-pfn-qfin-inst-merge](https://huggingface.co/pfnet/nekomata-14b-pfn-qfin-inst-merge)のggufフォーマット変換版です。\n\nimatrixのデータはTFMC/imatrix-dataset-for-japanese-llmを使用して作成しました。\n\n\n## ライセンス\ntongyi-qianwenライセンスになります。  \n[ご使用前にライセンスをご確認ください。](https://huggingface.co/pfnet/nekomata-14b-pfn-qfin-inst-merge/blob/main/LICENSE)\n\n## 他のモデル\n[mmnga/pfnet-nekomata-14b-pfn-qfin-gguf](https://huggingface.co/mmnga/pfnet-nekomata-14b-pfn-qfin-gguf)  \n[mmnga/pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf](https://huggingface.co/mmnga/pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf)  \n\n\n## Usage\n\n```\ngit clone https://github.com/ggerganov/llama.cpp.git\ncd llama.cpp\nmake -j\n./main -m 'pfnet-nekomata-14b-pfn-qfin-inst-merge-q4_0.gguf' -n 128 --temp 0.5 -p '### 指示:次の日本語を英語に翻訳してください。\\n\\n### 入力: 大規模言語モデル(だいきぼげんごモデル、英: large language model、LLM)は、多数のパラメータ(数千万から数十億)を持つ人工ニューラルネットワークで構成されるコンピュータ言語モデルで、膨大なラベルなしテキストを使用して自己教師あり学習または半教師あり学習によって訓練が行われる。 \\n\\n### 応答:'\n```",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "qwen",
    "en",
    "ja",
    "dataset:TFMC/imatrix-dataset-for-japanese-llm",
    "license:other",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 0,
  "downloads": 205,
  "gated": false,
  "private": false,
  "last_modified": "2024-04-24T14:39:32.000Z",
  "created_at": "2024-04-23T14:53:08.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "6627cb540d040d72c65f8929",
  "id": "mmnga/pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf",
  "modelId": "mmnga/pfnet-nekomata-14b-pfn-qfin-inst-merge-gguf",
  "sha": "8442313f5f26318ff836f1dbc5a68b7184ab166f",
  "createdAt": "2024-04-23T14:53:08.000Z",
  "lastModified": "2024-04-24T14:39:32.000Z",
  "author": "mmnga",
  "downloads": 205,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 26
}