richarderkhov/leia-llm_-_leia-swallow-13b-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "",
    "summary": "LEIA is a training technique for autoregressive LLMs that effectively improves their performance in languages other than English by enhancing cross-lingual knowledge transfer from English to a target language. This model is constructed by applying LEIA to Swallow, a Japanese-English bilingual LLM based on LLaMA 2. The model achieves enhanced performance on four out of six Japanese question answering benchmarks and equivalent performance on the remaining two, as reported below. Please refer to our paper or blog post (in Japanese) for further technical details.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nLeia-Swallow-13b - GGUF\n- Model creator: https://huggingface.co/leia-llm/\n- Original model: https://huggingface.co/leia-llm/Leia-Swallow-13b/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [Leia-Swallow-13b.Q2_K.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q2_K.gguf) | Q2_K | 4.58GB |\n| [Leia-Swallow-13b.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.IQ3_XS.gguf) | IQ3_XS | 5.06GB |\n| [Leia-Swallow-13b.IQ3_S.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.IQ3_S.gguf) | IQ3_S | 5.34GB |\n| [Leia-Swallow-13b.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q3_K_S.gguf) | Q3_K_S | 5.34GB |\n| [Leia-Swallow-13b.IQ3_M.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.IQ3_M.gguf) | IQ3_M | 5.64GB |\n| [Leia-Swallow-13b.Q3_K.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q3_K.gguf) | Q3_K | 5.97GB |\n| [Leia-Swallow-13b.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q3_K_M.gguf) | Q3_K_M | 5.97GB |\n| [Leia-Swallow-13b.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q3_K_L.gguf) | Q3_K_L | 6.52GB |\n| [Leia-Swallow-13b.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.IQ4_XS.gguf) | IQ4_XS | 6.61GB |\n| [Leia-Swallow-13b.Q4_0.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q4_0.gguf) | Q4_0 | 6.93GB |\n| [Leia-Swallow-13b.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.IQ4_NL.gguf) | IQ4_NL | 6.98GB |\n| [Leia-Swallow-13b.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q4_K_S.gguf) | Q4_K_S | 6.99GB |\n| [Leia-Swallow-13b.Q4_K.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q4_K.gguf) | Q4_K | 7.4GB |\n| [Leia-Swallow-13b.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q4_K_M.gguf) | Q4_K_M | 7.4GB |\n| [Leia-Swallow-13b.Q4_1.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q4_1.gguf) | Q4_1 | 7.69GB |\n| [Leia-Swallow-13b.Q5_0.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q5_0.gguf) | Q5_0 | 8.44GB |\n| [Leia-Swallow-13b.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q5_K_S.gguf) | Q5_K_S | 8.44GB |\n| [Leia-Swallow-13b.Q5_K.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q5_K.gguf) | Q5_K | 8.68GB |\n| [Leia-Swallow-13b.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q5_K_M.gguf) | Q5_K_M | 8.68GB |\n| [Leia-Swallow-13b.Q5_1.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q5_1.gguf) | Q5_1 | 9.19GB |\n| [Leia-Swallow-13b.Q6_K.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q6_K.gguf) | Q6_K | 10.03GB |\n| [Leia-Swallow-13b.Q8_0.gguf](https://huggingface.co/RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf/blob/main/Leia-Swallow-13b.Q8_0.gguf) | Q8_0 | 12.99GB |\n\n\n\n\nOriginal model description:\n---\nlicense: apache-2.0\nlanguage:\n- ja\n---\n# Leia-Swallow-13B\n\nLEIA is a training technique for autoregressive LLMs that effectively improves their performance in languages other than English by enhancing cross-lingual knowledge transfer from English to a target language.\nThis model is constructed by applying LEIA to Swallow, a Japanese-English bilingual LLM based on LLaMA 2.\nThe model achieves enhanced performance on four out of six Japanese question answering benchmarks and equivalent performance on the remaining two, as reported below.\n\nPlease refer to our paper or blog post (in Japanese) for further technical details.\n\n- [LEIA: Facilitating Cross-Lingual Knowledge Transfer in Language Models with Entity-based Data Augmentation](https://arxiv.org/abs/2402.11485) (arxiv.org)\n- [LEIA: 言語間転移学習でLLMを賢くする新しい方法](#) (zenn.dev)\n\n## Model List\n\n- [Leia-Swallow-7b](https://huggingface.co/leia-llm/Leia-Swallow-7b/)\n- [Leia-Swallow-13b](https://huggingface.co/leia-llm/Leia-Swallow-13b/)\n\n## Empirical Results\n\nThe model is assessed using the following six question answering benchmarks:\n- X-CODAH\n- X-CSQA\n- JCommonsenseQA\n- NIILC\n- JEMHopQA\n- JAQKET v2\n\n| Model | X-CODAH | X-CSQA | JCommonsenseQA | NIILC | JEMHopQA | JAQKET v2 |\n| ---- | ---- | ---- | ---- | ---- | ---- | ---- |\n| Swallow |　43.3　| 41.8 | 89.3 | 64.1 | 50.6 | 88.9 |\n| LEIA | **44.0** | **41.9** | 89.3 | **65.8** | 50.6 | **89.6** |\n\nFor further details of this experiment, please refer to [our paper](https://arxiv.org/abs/2402.11485).\n\n## Contributors\n\n- Ikuya Yamada (Studio Ousia, RIKEN)\n- Ryokan Ri (LY Corporation, SB Intuitions)\n\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "arxiv:2402.11485",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 0,
  "downloads": 211,
  "gated": false,
  "private": false,
  "last_modified": "2024-08-14T15:08:20.000Z",
  "created_at": "2024-08-14T12:24:25.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "66bca1f96f39f76a39271d98",
  "id": "RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf",
  "modelId": "RichardErkhov/leia-llm_-_Leia-Swallow-13b-gguf",
  "sha": "b39579ef3d5cea32c02828e1097cd3da4da730be",
  "createdAt": "2024-08-14T12:24:25.000Z",
  "lastModified": "2024-08-14T15:08:20.000Z",
  "author": "RichardErkhov",
  "downloads": 211,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}