ai-art-collab/gemma-2-ataraxy-gemmasutra-9b-slerp-gguf Q3_K_L GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
ai-art-collab/gemma-2-ataraxy-gemmasutra-9b-slerp-gguf overview
Vikhrmodels/Veles-2.5 subset evaluations: | Model | Perplexity | Lower Bound | Upper Bound | Confidence | |:--------------------------------------------|-------------:|--------------:|--------------:|-------------:| | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5KS | 4.2069 | 4.1722 | 4.2416 | 0.0348 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6K | 4.2071 | 4.1723 | 4.2419 | 0.0348 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5K | 4.2103 | 4.1755 | 4.2451 | 0.0348 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5KM | 4.2103 | 4.1755 | 4.2451 | 0.0348 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q80 | 4.2127 | 4.1778 | 4.2476 | 0.0349 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q50 | 4.2243 | 4.1893 | 4.2593 | 0.035 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q51 | 4.2284 | 4.1933 | 4.2635 | 0.0351 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4XS | 4.2335 | 4.1985 | 4.2685 | 0.035 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4NL | 4.2361 | 4.201 | 4.2712 | 0.0351 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4K | 4.2418 | 4.2066 | 4.277 | 0.0352 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4KM | 4.2418 | 4.2066 | 4.277 | 0.0352 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4KS | 4.254 | 4.2187 | 4.2893 | 0.0353 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q40 | 4.2543 | 4.2191 | 4.2895 | 0.0352 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q41 | 4.2636 | 4.2282 | 4.299 | 0.0354 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3KL | 4.2748 | 4.2393 | 4.3103 | 0.0355 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3KM | 4.3016 | 4.2658 | 4.3374 | 0.0358 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3K | 4.3016 | 4.2658 | 4.3374 | 0.0358 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3M | 4.3161 | 4.2801 | 4.3521 | 0.036 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3S | 4.3541 | 4.3177 | 4.3905 | 0.0364 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3KS | 4.3628 | 4.3265 | 4.3991 | 0.0363 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3XS | 4.3692 | 4.3328 | 4.4056 | 0.0364 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3XXS | 4.3951 | 4.3588 | 4.4314 | 0.0363 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2K | 4.4597 | 4.4226 | 4.4968 | 0.0371 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2M | 4.6029 | 4.5642 | 4.6416 | 0.0387 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2KS | 4.6483 | 4.6098 | 4.6868 | 0.0385 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2S | 4.7825 | 4.7421 | 4.8229 | 0.0404 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2XS | 4.9246 | 4.8831 | 4.9661 | 0.0415 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2XXS | 5.3178 | 5.2728 | 5.3628 | 0.045 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1M | 6.6785 | 6.6198 | 6.7372 | 0.0587 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1S | 8.3323 | 8.2575 | 8.4071 | 0.0748 | ggml-org/wikitext-2-raw-v1 evaluations: | Model | Perplexity | Lower Bound | Upper Bound | Confidence | |:--------------------------------------------|-------------:|--------------:|--------------:|-------------:| | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q80 | 7.8895 | 7.8347 | 7.9443 | 0.0548 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6K | 7.8896 | 7.8349 | 7.9443 | 0.0547 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5KS | 7.8957 | 7.841 | 7.9504 | 0.0547 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5K | 7.9047 | 7.8499 | 7.9595 | 0.0548 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5KM | 7.9047 | 7.8499 | 7.9595 | 0.0548 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q51 | 7.9092 | 7.8543 | 7.9641 | 0.0549 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q50 | 7.921 | 7.8661 | 7.976 | 0.0549 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4XS | 7.9583 | 7.9032 | 8.0135 | 0.0551 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4NL | 7.9635 | 7.9082 | 8.0187 | 0.0553 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4K | 7.9777 | 7.9223 | 8.0331 | 0.0554 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4KM | 7.9777 | 7.9223 | 8.0331 | 0.0554 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4KS | 8.0115 | 7.9557 | 8.0673 | 0.0558 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q41 | 8.0142 | 7.9586 | 8.0698 | 0.0556 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q40 | 8.0419 | 7.9862 | 8.0976 | 0.0557 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3KL | 8.0924 | 8.036 | 8.1487 | 0.0563 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3M | 8.146 | 8.0892 | 8.2028 | 0.0568 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3KM | 8.1713 | 8.1142 | 8.2284 | 0.0571 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3K | 8.1713 | 8.1142 | 8.2284 | 0.0571 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3S | 8.2287 | 8.1711 | 8.2863 | 0.0576 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3XS | 8.3294 | 8.271 | 8.3878 | 0.0583 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3KS | 8.3341 | 8.2759 | 8.3923 | 0.0582 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3XXS | 8.3716 | 8.3135 | 8.4297 | 0.0581 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2K | 8.6176 | 8.5579 | 8.6773 | 0.0597 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2M | 8.7986 | 8.737 | 8.8602 | 0.0616 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2KS | 9.1279 | 9.0646 | 9.1912 | 0.0633 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2S | 9.2979 | 9.2323 | 9.3635 | 0.0656 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2XS | 9.6843 | 9.6161 | 9.7525 | 0.0682 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2XXS | 10.5431 | 10.4683 | 10.6179 | 0.0748 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1M | 12.964 | 12.8689 | 13.0591 | 0.0951 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1S | 15.2188 | 15.1051 | 15.3325 | 0.1137 |
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_M.gguf | GGUF | IQ1_M | 2.37 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_S.gguf | GGUF | IQ1_S | 2.22 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_M.gguf | GGUF | IQ2_M | 3.20 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_S.gguf | GGUF | IQ2_S | 2.99 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XS.gguf | GGUF | IQ2_XS | 2.86 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XXS.gguf | GGUF | IQ2_XXS | 2.63 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_M.gguf | GGUF | IQ3_M | 4.19 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_S.gguf | GGUF | IQ3_S | 4.04 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XS.gguf | GGUF | IQ3_XS | 3.86 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XXS.gguf | GGUF | IQ3_XXS | 3.54 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_NL.gguf | GGUF | IQ4_NL | 5.07 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_XS.gguf | GGUF | IQ4_XS | 4.83 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K.gguf | GGUF | Q2_K | 3.54 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K_S.gguf | GGUF | Q2_K_S | 3.31 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K.gguf | GGUF | Q3_K | 4.43 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_L.gguf | GGUF | Q3_K_L | 4.78 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_M.gguf | GGUF | Q3_K_M | 4.43 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_S.gguf | GGUF | Q3_K_S | 4.04 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_0.gguf | GGUF | — | 5.07 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_1.gguf | GGUF | — | 5.55 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K.gguf | GGUF | Q4_K | 5.37 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_M.gguf | GGUF | Q4_K_M | 5.37 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_S.gguf | GGUF | Q4_K_S | 5.10 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_0.gguf | GGUF | — | 6.04 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_1.gguf | GGUF | — | 6.52 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K.gguf | GGUF | Q5_K | 6.19 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_M.gguf | GGUF | Q5_K_M | 6.19 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_S.gguf | GGUF | Q5_K_S | 6.04 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6_K.gguf | GGUF | Q6_K | 7.07 GB | Download |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q8_0.gguf | GGUF | — | 9.15 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"base_model": [
"recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp"
],
"model-index": [
{
"name": "recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp-GGUF",
"results": [
{
"task": {
"type": "PPL"
},
"dataset": {
"name": "Vikhrmodels/Veles-2.5",
"type": "Dummy"
},
"metrics": [
{
"name": "Q5_K_S",
"type": "perplexity",
"value": "4.2069 +/- 0.0348",
"verified": false
},
{
"name": "Q6_K",
"type": "perplexity",
"value": "4.2071 +/- 0.0348",
"verified": false
},
{
"name": "Q5_K",
"type": "perplexity",
"value": "4.2103 +/- 0.0348",
"verified": false
},
{
"name": "Q5_K_M",
"type": "perplexity",
"value": "4.2103 +/- 0.0348",
"verified": false
},
{
"name": "Q8_0",
"type": "perplexity",
"value": "4.2127 +/- 0.0349",
"verified": false
},
{
"name": "Q5_0",
"type": "perplexity",
"value": "4.2243 +/- 0.0350",
"verified": false
},
{
"name": "Q5_1",
"type": "perplexity",
"value": "4.2284 +/- 0.0351",
"verified": false
},
{
"name": "IQ4_XS",
"type": "perplexity",
"value": "4.2335 +/- 0.0350",
"verified": false
},
{
"name": "IQ4_NL",
"type": "perplexity",
"value": "4.2361 +/- 0.0351",
"verified": false
},
{
"name": "Q4_K",
"type": "perplexity",
"value": "4.2418 +/- 0.0352",
"verified": false
},
{
"name": "Q4_K_M",
"type": "perplexity",
"value": "4.2418 +/- 0.0352",
"verified": false
},
{
"name": "Q4_K_S",
"type": "perplexity",
"value": "4.2540 +/- 0.0353",
"verified": false
},
{
"name": "Q4_0",
"type": "perplexity",
"value": "4.2543 +/- 0.0352",
"verified": false
},
{
"name": "Q4_1",
"type": "perplexity",
"value": "4.2636 +/- 0.0354",
"verified": false
},
{
"name": "Q3_K_L",
"type": "perplexity",
"value": "4.2748 +/- 0.0355",
"verified": false
},
{
"name": "Q3_K_M",
"type": "perplexity",
"value": "4.3016 +/- 0.0358",
"verified": false
},
{
"name": "Q3_K",
"type": "perplexity",
"value": "4.3016 +/- 0.0358",
"verified": false
},
{
"name": "IQ3_M",
"type": "perplexity",
"value": "4.3161 +/- 0.0360",
"verified": false
},
{
"name": "IQ3_S",
"type": "perplexity",
"value": "4.3541 +/- 0.0364",
"verified": false
},
{
"name": "Q3_K_S",
"type": "perplexity",
"value": "4.3628 +/- 0.0363",
"verified": false
},
{
"name": "IQ3_XS",
"type": "perplexity",
"value": "4.3692 +/- 0.0364",
"verified": false
},
{
"name": "IQ3_XXS",
"type": "perplexity",
"value": "4.3951 +/- 0.0363",
"verified": false
},
{
"name": "Q2_K",
"type": "perplexity",
"value": "4.4597 +/- 0.0371",
"verified": false
},
{
"name": "IQ2_M",
"type": "perplexity",
"value": "4.6029 +/- 0.0387",
"verified": false
},
{
"name": "Q2_K_S",
"type": "perplexity",
"value": "4.6483 +/- 0.0385",
"verified": false
},
{
"name": "IQ2_S",
"type": "perplexity",
"value": "4.7825 +/- 0.0404",
"verified": false
},
{
"name": "IQ2_XS",
"type": "perplexity",
"value": "4.9246 +/- 0.0415",
"verified": false
},
{
"name": "IQ2_XXS",
"type": "perplexity",
"value": "5.3178 +/- 0.0450",
"verified": false
},
{
"name": "IQ1_M",
"type": "perplexity",
"value": "6.6785 +/- 0.0587",
"verified": false
},
{
"name": "IQ1_S",
"type": "perplexity",
"value": "8.3323 +/- 0.0748",
"verified": false
}
]
},
{
"task": {
"type": "PPL"
},
"dataset": {
"name": "ggml-org/wikitext-2-raw-v1",
"type": "Dummy"
},
"metrics": [
{
"name": "Q8_0",
"type": "perplexity",
"value": "7.8895 +/- 0.0548",
"verified": false
},
{
"name": "Q6_K",
"type": "perplexity",
"value": "7.8896 +/- 0.0547",
"verified": false
},
{
"name": "Q5_K_S",
"type": "perplexity",
"value": "7.8957 +/- 0.0547",
"verified": false
},
{
"name": "Q5_K",
"type": "perplexity",
"value": "7.9047 +/- 0.0548",
"verified": false
},
{
"name": "Q5_K_M",
"type": "perplexity",
"value": "7.9047 +/- 0.0548",
"verified": false
},
{
"name": "Q5_1",
"type": "perplexity",
"value": "7.9092 +/- 0.0549",
"verified": false
},
{
"name": "Q5_0",
"type": "perplexity",
"value": "7.9210 +/- 0.0549",
"verified": false
},
{
"name": "IQ4_XS",
"type": "perplexity",
"value": "7.9583 +/- 0.0551",
"verified": false
},
{
"name": "IQ4_NL",
"type": "perplexity",
"value": "7.9635 +/- 0.0553",
"verified": false
},
{
"name": "Q4_K",
"type": "perplexity",
"value": "7.9777 +/- 0.0554",
"verified": false
},
{
"name": "Q4_K_M",
"type": "perplexity",
"value": "7.9777 +/- 0.0554",
"verified": false
},
{
"name": "Q4_K_S",
"type": "perplexity",
"value": "8.0115 +/- 0.0558",
"verified": false
},
{
"name": "Q4_1",
"type": "perplexity",
"value": "8.0142 +/- 0.0556",
"verified": false
},
{
"name": "Q4_0",
"type": "perplexity",
"value": "8.0419 +/- 0.0557",
"verified": false
},
{
"name": "Q3_K_L",
"type": "perplexity",
"value": "8.0924 +/- 0.0563",
"verified": false
},
{
"name": "IQ3_M",
"type": "perplexity",
"value": "8.1460 +/- 0.0568",
"verified": false
},
{
"name": "Q3_K_M",
"type": "perplexity",
"value": "8.1713 +/- 0.0571",
"verified": false
},
{
"name": "Q3_K",
"type": "perplexity",
"value": "8.1713 +/- 0.0571",
"verified": false
},
{
"name": "IQ3_S",
"type": "perplexity",
"value": "8.2287 +/- 0.0576",
"verified": false
},
{
"name": "IQ3_XS",
"type": "perplexity",
"value": "8.3294 +/- 0.0583",
"verified": false
},
{
"name": "Q3_K_S",
"type": "perplexity",
"value": "8.3341 +/- 0.0582",
"verified": false
},
{
"name": "IQ3_XXS",
"type": "perplexity",
"value": "8.3716 +/- 0.0581",
"verified": false
},
{
"name": "Q2_K",
"type": "perplexity",
"value": "8.6176 +/- 0.0597",
"verified": false
},
{
"name": "IQ2_M",
"type": "perplexity",
"value": "8.7986 +/- 0.0616",
"verified": false
},
{
"name": "Q2_K_S",
"type": "perplexity",
"value": "9.1279 +/- 0.0633",
"verified": false
},
{
"name": "IQ2_S",
"type": "perplexity",
"value": "9.2979 +/- 0.0656",
"verified": false
},
{
"name": "IQ2_XS",
"type": "perplexity",
"value": "9.6843 +/- 0.0682",
"verified": false
},
{
"name": "IQ2_XXS",
"type": "perplexity",
"value": "10.5431 +/- 0.0748",
"verified": false
},
{
"name": "IQ1_M",
"type": "perplexity",
"value": "12.9640 +/- 0.0951",
"verified": false
},
{
"name": "IQ1_S",
"type": "perplexity",
"value": "15.2188 +/- 0.1137",
"verified": false
}
]
}
]
}
],
"frontmatter": {
"base_model": [
"recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp",
"name: recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp-GGUF",
"task:",
"name: Q5_K_S",
"name: Q6_K",
"name: Q5_K",
"name: Q5_K_M",
"name: Q8_0",
"name: Q5_0",
"name: Q5_1",
"name: IQ4_XS",
"name: IQ4_NL",
"name: Q4_K",
"name: Q4_K_M",
"name: Q4_K_S",
"name: Q4_0",
"name: Q4_1",
"name: Q3_K_L",
"name: Q3_K_M",
"name: Q3_K",
"name: IQ3_M",
"name: IQ3_S",
"name: Q3_K_S",
"name: IQ3_XS",
"name: IQ3_XXS",
"name: Q2_K",
"name: IQ2_M",
"name: Q2_K_S",
"name: IQ2_S",
"name: IQ2_XS",
"name: IQ2_XXS",
"name: IQ1_M",
"name: IQ1_S",
"task:",
"name: Q8_0",
"name: Q6_K",
"name: Q5_K_S",
"name: Q5_K",
"name: Q5_K_M",
"name: Q5_1",
"name: Q5_0",
"name: IQ4_XS",
"name: IQ4_NL",
"name: Q4_K",
"name: Q4_K_M",
"name: Q4_K_S",
"name: Q4_1",
"name: Q4_0",
"name: Q3_K_L",
"name: IQ3_M",
"name: Q3_K_M",
"name: Q3_K",
"name: IQ3_S",
"name: IQ3_XS",
"name: Q3_K_S",
"name: IQ3_XXS",
"name: Q2_K",
"name: IQ2_M",
"name: Q2_K_S",
"name: IQ2_S",
"name: IQ2_XS",
"name: IQ2_XXS",
"name: IQ1_M",
"name: IQ1_S"
]
},
"hero_image_url": "",
"summary": "Vikhrmodels/Veles-2.5 subset evaluations: | Model | Perplexity | Lower Bound | Upper Bound | Confidence | |:--------------------------------------------|-------------:|--------------:|--------------:|-------------:| | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_S | 4.2069 | 4.1722 | 4.2416 | 0.0348 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6_K | 4.2071 | 4.1723 | 4.2419 | 0.0348 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K | 4.2103 | 4.1755 | 4.2451 | 0.0348 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_M | 4.2103 | 4.1755 | 4.2451 | 0.0348 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q8_0 | 4.2127 | 4.1778 | 4.2476 | 0.0349 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_0 | 4.2243 | 4.1893 | 4.2593 | 0.035 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_1 | 4.2284 | 4.1933 | 4.2635 | 0.0351 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_XS | 4.2335 | 4.1985 | 4.2685 | 0.035 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_NL | 4.2361 | 4.201 | 4.2712 | 0.0351 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K | 4.2418 | 4.2066 | 4.277 | 0.0352 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_M | 4.2418 | 4.2066 | 4.277 | 0.0352 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_S | 4.254 | 4.2187 | 4.2893 | 0.0353 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_0 | 4.2543 | 4.2191 | 4.2895 | 0.0352 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_1 | 4.2636 | 4.2282 | 4.299 | 0.0354 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_L | 4.2748 | 4.2393 | 4.3103 | 0.0355 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_M | 4.3016 | 4.2658 | 4.3374 | 0.0358 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K | 4.3016 | 4.2658 | 4.3374 | 0.0358 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_M | 4.3161 | 4.2801 | 4.3521 | 0.036 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_S | 4.3541 | 4.3177 | 4.3905 | 0.0364 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_S | 4.3628 | 4.3265 | 4.3991 | 0.0363 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XS | 4.3692 | 4.3328 | 4.4056 | 0.0364 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XXS | 4.3951 | 4.3588 | 4.4314 | 0.0363 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K | 4.4597 | 4.4226 | 4.4968 | 0.0371 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_M | 4.6029 | 4.5642 | 4.6416 | 0.0387 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K_S | 4.6483 | 4.6098 | 4.6868 | 0.0385 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_S | 4.7825 | 4.7421 | 4.8229 | 0.0404 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XS | 4.9246 | 4.8831 | 4.9661 | 0.0415 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XXS | 5.3178 | 5.2728 | 5.3628 | 0.045 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_M | 6.6785 | 6.6198 | 6.7372 | 0.0587 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_S | 8.3323 | 8.2575 | 8.4071 | 0.0748 | ggml-org/wikitext-2-raw-v1 evaluations: | Model | Perplexity | Lower Bound | Upper Bound | Confidence | |:--------------------------------------------|-------------:|--------------:|--------------:|-------------:| | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q8_0 | 7.8895 | 7.8347 | 7.9443 | 0.0548 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6_K | 7.8896 | 7.8349 | 7.9443 | 0.0547 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_S | 7.8957 | 7.841 | 7.9504 | 0.0547 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K | 7.9047 | 7.8499 | 7.9595 | 0.0548 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_M | 7.9047 | 7.8499 | 7.9595 | 0.0548 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_1 | 7.9092 | 7.8543 | 7.9641 | 0.0549 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_0 | 7.921 | 7.8661 | 7.976 | 0.0549 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_XS | 7.9583 | 7.9032 | 8.0135 | 0.0551 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_NL | 7.9635 | 7.9082 | 8.0187 | 0.0553 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K | 7.9777 | 7.9223 | 8.0331 | 0.0554 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_M | 7.9777 | 7.9223 | 8.0331 | 0.0554 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_S | 8.0115 | 7.9557 | 8.0673 | 0.0558 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_1 | 8.0142 | 7.9586 | 8.0698 | 0.0556 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_0 | 8.0419 | 7.9862 | 8.0976 | 0.0557 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_L | 8.0924 | 8.036 | 8.1487 | 0.0563 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_M | 8.146 | 8.0892 | 8.2028 | 0.0568 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_M | 8.1713 | 8.1142 | 8.2284 | 0.0571 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K | 8.1713 | 8.1142 | 8.2284 | 0.0571 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_S | 8.2287 | 8.1711 | 8.2863 | 0.0576 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XS | 8.3294 | 8.271 | 8.3878 | 0.0583 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_S | 8.3341 | 8.2759 | 8.3923 | 0.0582 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XXS | 8.3716 | 8.3135 | 8.4297 | 0.0581 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K | 8.6176 | 8.5579 | 8.6773 | 0.0597 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_M | 8.7986 | 8.737 | 8.8602 | 0.0616 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K_S | 9.1279 | 9.0646 | 9.1912 | 0.0633 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_S | 9.2979 | 9.2323 | 9.3635 | 0.0656 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XS | 9.6843 | 9.6161 | 9.7525 | 0.0682 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XXS | 10.5431 | 10.4683 | 10.6179 | 0.0748 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_M | 12.964 | 12.8689 | 13.0591 | 0.0951 | | Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_S | 15.2188 | 15.1051 | 15.3325 | 0.1137 |",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nbase_model:\n- recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp\n\nmodel-index:\n - name: recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp-GGUF\n results:\n - task:\n type: PPL\n dataset:\n name: Vikhrmodels/Veles-2.5\n type: Dummy\n metrics:\n - name: Q5_K_S\n type: perplexity\n value: '4.2069 +/- 0.0348'\n - name: Q6_K\n type: perplexity\n value: '4.2071 +/- 0.0348'\n - name: Q5_K\n type: perplexity\n value: '4.2103 +/- 0.0348'\n - name: Q5_K_M\n type: perplexity\n value: '4.2103 +/- 0.0348'\n - name: Q8_0\n type: perplexity\n value: '4.2127 +/- 0.0349'\n - name: Q5_0\n type: perplexity\n value: '4.2243 +/- 0.0350'\n - name: Q5_1\n type: perplexity\n value: '4.2284 +/- 0.0351'\n - name: IQ4_XS\n type: perplexity\n value: '4.2335 +/- 0.0350'\n - name: IQ4_NL\n type: perplexity\n value: '4.2361 +/- 0.0351'\n - name: Q4_K\n type: perplexity\n value: '4.2418 +/- 0.0352'\n - name: Q4_K_M\n type: perplexity\n value: '4.2418 +/- 0.0352'\n - name: Q4_K_S\n type: perplexity\n value: '4.2540 +/- 0.0353'\n - name: Q4_0\n type: perplexity\n value: '4.2543 +/- 0.0352'\n - name: Q4_1\n type: perplexity\n value: '4.2636 +/- 0.0354'\n - name: Q3_K_L\n type: perplexity\n value: '4.2748 +/- 0.0355'\n - name: Q3_K_M\n type: perplexity\n value: '4.3016 +/- 0.0358'\n - name: Q3_K\n type: perplexity\n value: '4.3016 +/- 0.0358'\n - name: IQ3_M\n type: perplexity\n value: '4.3161 +/- 0.0360'\n - name: IQ3_S\n type: perplexity\n value: '4.3541 +/- 0.0364'\n - name: Q3_K_S\n type: perplexity\n value: '4.3628 +/- 0.0363'\n - name: IQ3_XS\n type: perplexity\n value: '4.3692 +/- 0.0364'\n - name: IQ3_XXS\n type: perplexity\n value: '4.3951 +/- 0.0363'\n - name: Q2_K\n type: perplexity\n value: '4.4597 +/- 0.0371'\n - name: IQ2_M\n type: perplexity\n value: '4.6029 +/- 0.0387'\n - name: Q2_K_S\n type: perplexity\n value: '4.6483 +/- 0.0385'\n - name: IQ2_S\n type: perplexity\n value: '4.7825 +/- 0.0404'\n - name: IQ2_XS\n type: perplexity\n value: '4.9246 +/- 0.0415'\n - name: IQ2_XXS\n type: perplexity\n value: '5.3178 +/- 0.0450'\n - name: IQ1_M\n type: perplexity\n value: '6.6785 +/- 0.0587'\n - name: IQ1_S\n type: perplexity\n value: '8.3323 +/- 0.0748'\n - task:\n type: PPL\n dataset:\n name: ggml-org/wikitext-2-raw-v1\n type: Dummy\n metrics:\n - name: Q8_0\n type: perplexity\n value: '7.8895 +/- 0.0548'\n - name: Q6_K\n type: perplexity\n value: '7.8896 +/- 0.0547'\n - name: Q5_K_S\n type: perplexity\n value: '7.8957 +/- 0.0547'\n - name: Q5_K\n type: perplexity\n value: '7.9047 +/- 0.0548'\n - name: Q5_K_M\n type: perplexity\n value: '7.9047 +/- 0.0548'\n - name: Q5_1\n type: perplexity\n value: '7.9092 +/- 0.0549'\n - name: Q5_0\n type: perplexity\n value: '7.9210 +/- 0.0549'\n - name: IQ4_XS\n type: perplexity\n value: '7.9583 +/- 0.0551'\n - name: IQ4_NL\n type: perplexity\n value: '7.9635 +/- 0.0553'\n - name: Q4_K\n type: perplexity\n value: '7.9777 +/- 0.0554'\n - name: Q4_K_M\n type: perplexity\n value: '7.9777 +/- 0.0554'\n - name: Q4_K_S\n type: perplexity\n value: '8.0115 +/- 0.0558'\n - name: Q4_1\n type: perplexity\n value: '8.0142 +/- 0.0556'\n - name: Q4_0\n type: perplexity\n value: '8.0419 +/- 0.0557'\n - name: Q3_K_L\n type: perplexity\n value: '8.0924 +/- 0.0563'\n - name: IQ3_M\n type: perplexity\n value: '8.1460 +/- 0.0568'\n - name: Q3_K_M\n type: perplexity\n value: '8.1713 +/- 0.0571'\n - name: Q3_K\n type: perplexity\n value: '8.1713 +/- 0.0571'\n - name: IQ3_S\n type: perplexity\n value: '8.2287 +/- 0.0576'\n - name: IQ3_XS\n type: perplexity\n value: '8.3294 +/- 0.0583'\n - name: Q3_K_S\n type: perplexity\n value: '8.3341 +/- 0.0582'\n - name: IQ3_XXS\n type: perplexity\n value: '8.3716 +/- 0.0581'\n - name: Q2_K\n type: perplexity\n value: '8.6176 +/- 0.0597'\n - name: IQ2_M\n type: perplexity\n value: '8.7986 +/- 0.0616'\n - name: Q2_K_S\n type: perplexity\n value: '9.1279 +/- 0.0633'\n - name: IQ2_S\n type: perplexity\n value: '9.2979 +/- 0.0656'\n - name: IQ2_XS\n type: perplexity\n value: '9.6843 +/- 0.0682'\n - name: IQ2_XXS\n type: perplexity\n value: '10.5431 +/- 0.0748'\n - name: IQ1_M\n type: perplexity\n value: '12.9640 +/- 0.0951'\n - name: IQ1_S\n type: perplexity\n value: '15.2188 +/- 0.1137'\n---\n\n# Perplexity evaluations\n\nVikhrmodels/Veles-2.5 subset evaluations:\n| Model | Perplexity | Lower Bound | Upper Bound | Confidence |\n|:--------------------------------------------|-------------:|--------------:|--------------:|-------------:|\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_S | 4.2069 | 4.1722 | 4.2416 | 0.0348 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6_K | 4.2071 | 4.1723 | 4.2419 | 0.0348 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K | 4.2103 | 4.1755 | 4.2451 | 0.0348 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_M | 4.2103 | 4.1755 | 4.2451 | 0.0348 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q8_0 | 4.2127 | 4.1778 | 4.2476 | 0.0349 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_0 | 4.2243 | 4.1893 | 4.2593 | 0.035 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_1 | 4.2284 | 4.1933 | 4.2635 | 0.0351 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_XS | 4.2335 | 4.1985 | 4.2685 | 0.035 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_NL | 4.2361 | 4.201 | 4.2712 | 0.0351 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K | 4.2418 | 4.2066 | 4.277 | 0.0352 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_M | 4.2418 | 4.2066 | 4.277 | 0.0352 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_S | 4.254 | 4.2187 | 4.2893 | 0.0353 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_0 | 4.2543 | 4.2191 | 4.2895 | 0.0352 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_1 | 4.2636 | 4.2282 | 4.299 | 0.0354 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_L | 4.2748 | 4.2393 | 4.3103 | 0.0355 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_M | 4.3016 | 4.2658 | 4.3374 | 0.0358 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K | 4.3016 | 4.2658 | 4.3374 | 0.0358 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_M | 4.3161 | 4.2801 | 4.3521 | 0.036 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_S | 4.3541 | 4.3177 | 4.3905 | 0.0364 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_S | 4.3628 | 4.3265 | 4.3991 | 0.0363 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XS | 4.3692 | 4.3328 | 4.4056 | 0.0364 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XXS | 4.3951 | 4.3588 | 4.4314 | 0.0363 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K | 4.4597 | 4.4226 | 4.4968 | 0.0371 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_M | 4.6029 | 4.5642 | 4.6416 | 0.0387 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K_S | 4.6483 | 4.6098 | 4.6868 | 0.0385 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_S | 4.7825 | 4.7421 | 4.8229 | 0.0404 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XS | 4.9246 | 4.8831 | 4.9661 | 0.0415 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XXS | 5.3178 | 5.2728 | 5.3628 | 0.045 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_M | 6.6785 | 6.6198 | 6.7372 | 0.0587 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_S | 8.3323 | 8.2575 | 8.4071 | 0.0748 |\n\nggml-org/wikitext-2-raw-v1 evaluations:\n| Model | Perplexity | Lower Bound | Upper Bound | Confidence |\n|:--------------------------------------------|-------------:|--------------:|--------------:|-------------:|\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q8_0 | 7.8895 | 7.8347 | 7.9443 | 0.0548 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6_K | 7.8896 | 7.8349 | 7.9443 | 0.0547 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_S | 7.8957 | 7.841 | 7.9504 | 0.0547 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K | 7.9047 | 7.8499 | 7.9595 | 0.0548 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_M | 7.9047 | 7.8499 | 7.9595 | 0.0548 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_1 | 7.9092 | 7.8543 | 7.9641 | 0.0549 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_0 | 7.921 | 7.8661 | 7.976 | 0.0549 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_XS | 7.9583 | 7.9032 | 8.0135 | 0.0551 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_NL | 7.9635 | 7.9082 | 8.0187 | 0.0553 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K | 7.9777 | 7.9223 | 8.0331 | 0.0554 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_M | 7.9777 | 7.9223 | 8.0331 | 0.0554 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_S | 8.0115 | 7.9557 | 8.0673 | 0.0558 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_1 | 8.0142 | 7.9586 | 8.0698 | 0.0556 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_0 | 8.0419 | 7.9862 | 8.0976 | 0.0557 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_L | 8.0924 | 8.036 | 8.1487 | 0.0563 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_M | 8.146 | 8.0892 | 8.2028 | 0.0568 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_M | 8.1713 | 8.1142 | 8.2284 | 0.0571 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K | 8.1713 | 8.1142 | 8.2284 | 0.0571 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_S | 8.2287 | 8.1711 | 8.2863 | 0.0576 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XS | 8.3294 | 8.271 | 8.3878 | 0.0583 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_S | 8.3341 | 8.2759 | 8.3923 | 0.0582 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XXS | 8.3716 | 8.3135 | 8.4297 | 0.0581 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K | 8.6176 | 8.5579 | 8.6773 | 0.0597 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_M | 8.7986 | 8.737 | 8.8602 | 0.0616 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K_S | 9.1279 | 9.0646 | 9.1912 | 0.0633 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_S | 9.2979 | 9.2323 | 9.3635 | 0.0656 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XS | 9.6843 | 9.6161 | 9.7525 | 0.0682 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XXS | 10.5431 | 10.4683 | 10.6179 | 0.0748 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_M | 12.964 | 12.8689 | 13.0591 | 0.0951 |\n| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_S | 15.2188 | 15.1051 | 15.3325 | 0.1137 |",
"related_quantizations": []
},
"tags": [
"gguf",
"base_model:recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp",
"base_model:quantized:recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp",
"model-index",
"endpoints_compatible",
"region:us",
"imatrix",
"conversational"
],
"likes": 1,
"downloads": 170,
"gated": false,
"private": false,
"last_modified": "2024-09-17T07:20:04.000Z",
"created_at": "2024-09-15T22:21:27.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "66e75de7444055a5700e9805",
"id": "AI-Art-Collab/Gemma-2-Ataraxy-Gemmasutra-9B-slerp-GGUF",
"modelId": "AI-Art-Collab/Gemma-2-Ataraxy-Gemmasutra-9B-slerp-GGUF",
"sha": "600884bdd7caa1578815675f81675051e0526c2d",
"createdAt": "2024-09-15T22:21:27.000Z",
"lastModified": "2024-09-17T07:20:04.000Z",
"author": "AI-Art-Collab",
"downloads": 170,
"likes": 1,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 32
}