bartowski/granite-embedding-125m-english-gguf IQ3_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
bartowski/granite-embedding-125m-english-gguf overview
Comprehensive model page for bartowski/granite-embedding-125m-english-gguf
Downloads
1,131
Likes
0
Pipeline
text-generation
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
17 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| granite-embedding-125m-english-IQ3_M.gguf | GGUF | IQ3_M | 70.76 MB | Download |
| granite-embedding-125m-english-IQ4_NL.gguf | GGUF | IQ4_NL | 79.71 MB | Download |
| granite-embedding-125m-english-IQ4_XS.gguf | GGUF | IQ4_XS | 77.25 MB | Download |
| granite-embedding-125m-english-Q3_K_L.gguf | GGUF | Q3_K_L | 79.11 MB | Download |
| granite-embedding-125m-english-Q3_K_M.gguf | GGUF | Q3_K_M | 74.19 MB | Download |
| granite-embedding-125m-english-Q3_K_XL.gguf | GGUF | Q3_K_XL | 88.02 MB | Download |
| granite-embedding-125m-english-Q4_0.gguf | GGUF | — | 79.42 MB | Download |
| granite-embedding-125m-english-Q4_K_L.gguf | GGUF | Q4_K_L | 92.69 MB | Download |
| granite-embedding-125m-english-Q4_K_M.gguf | GGUF | Q4_K_M | 83.78 MB | Download |
| granite-embedding-125m-english-Q4_K_S.gguf | GGUF | Q4_K_S | 79.99 MB | Download |
| granite-embedding-125m-english-Q5_K_L.gguf | GGUF | Q5_K_L | 100.71 MB | Download |
| granite-embedding-125m-english-Q5_K_M.gguf | GGUF | Q5_K_M | 91.79 MB | Download |
| granite-embedding-125m-english-Q5_K_S.gguf | GGUF | Q5_K_S | 89.55 MB | Download |
| granite-embedding-125m-english-Q6_K.gguf | GGUF | Q6_K | 100.31 MB | Download |
| granite-embedding-125m-english-Q6_K_L.gguf | GGUF | Q6_K_L | 109.22 MB | Download |
| granite-embedding-125m-english-Q8_0.gguf | GGUF | — | 128.84 MB | Download |
| granite-embedding-125m-english-f16.gguf | GGUF | F16 | 239.29 MB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"quantized_by": "bartowski",
"pipeline_tag": "text-generation",
"language": [
"en"
],
"tags": [
"language",
"granite",
"embeddings"
],
"license": "apache-2.0",
"base_model": "ibm-granite/granite-embedding-125m-english",
"model-index": [
{
"name": "ibm-granite/granite-embedding-125m-english",
"results": [
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB ArguaAna",
"type": "mteb/arguana",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.33642,
"verified": false
},
{
"type": "map_at_10",
"value": 0.49716,
"verified": false
},
{
"type": "map_at_100",
"value": 0.50519,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.50521,
"verified": false
},
{
"type": "map_at_3",
"value": 0.45057,
"verified": false
},
{
"type": "map_at_5",
"value": 0.47774,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.34922,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.50197,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.50992,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.50994,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.45484,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.48272,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.33642,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.58401,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.6157,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.61608,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.48825,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.53689,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.33642,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.08606,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.00994,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.001,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.19915,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.14296,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.33642,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.8606,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.9936,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.99644,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.59744,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.71479,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB ClimateFEVER",
"type": "mteb/climate-fever",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.1457,
"verified": false
},
{
"type": "map_at_10",
"value": 0.24102,
"verified": false
},
{
"type": "map_at_100",
"value": 0.25826,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.26021,
"verified": false
},
{
"type": "map_at_3",
"value": 0.20346,
"verified": false
},
{
"type": "map_at_5",
"value": 0.22228,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.32573,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.44411,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.45176,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.45209,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.4126,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.43312,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.32573,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.3315,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.39898,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.43151,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.27683,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.29538,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.32573,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.10176,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01754,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00236,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.20347,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.15505,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.1457,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.38825,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.62237,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.8022,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.25245,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.30821,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackAndroidRetrieval",
"type": "mteb/cqadupstack-android",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.36964,
"verified": false
},
{
"type": "map_at_10",
"value": 0.5043,
"verified": false
},
{
"type": "map_at_100",
"value": 0.52066,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.52175,
"verified": false
},
{
"type": "map_at_3",
"value": 0.46001,
"verified": false
},
{
"type": "map_at_5",
"value": 0.48312,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.45923,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.56733,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.57292,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.57321,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.54053,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.55556,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.45923,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.57667,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.62373,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.6368,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.51843,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.54257,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.45923,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.11316,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01705,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00216,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.2537,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.1814,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.36964,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.71234,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.90421,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.98296,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.53655,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.60996,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackEnglishRetrieval",
"type": "mteb/cqadupstack-english",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.36198,
"verified": false
},
{
"type": "map_at_10",
"value": 0.49199,
"verified": false
},
{
"type": "map_at_100",
"value": 0.50602,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.50736,
"verified": false
},
{
"type": "map_at_3",
"value": 0.45678,
"verified": false
},
{
"type": "map_at_5",
"value": 0.47605,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.45478,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.55075,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.55656,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.55688,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.52887,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.54282,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.45478,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.55505,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.59606,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.61255,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.51124,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.53166,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.45478,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.10752,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01666,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00211,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.25053,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.17694,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.36198,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.66465,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.83632,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.93276,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.53207,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.59169,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackGamingRetrieval",
"type": "mteb/cqadupstack-gaming",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.44157,
"verified": false
},
{
"type": "map_at_10",
"value": 0.57753,
"verified": false
},
{
"type": "map_at_100",
"value": 0.58698,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.5874,
"verified": false
},
{
"type": "map_at_3",
"value": 0.54223,
"verified": false
},
{
"type": "map_at_5",
"value": 0.56307,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.50094,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.607,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.6126,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.6128,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.58265,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.59817,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.50094,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.63641,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.67055,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.67855,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.58022,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.6097,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.50094,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.10182,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01278,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00138,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.2581,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.17755,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.44157,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.7778,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.92244,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.9781,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.63087,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.70172,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackGisRetrieval",
"type": "mteb/cqadupstack-gis",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.29532,
"verified": false
},
{
"type": "map_at_10",
"value": 0.40214,
"verified": false
},
{
"type": "map_at_100",
"value": 0.41289,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.41359,
"verified": false
},
{
"type": "map_at_3",
"value": 0.37086,
"verified": false
},
{
"type": "map_at_5",
"value": 0.38889,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.3209,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.42423,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.43342,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.43395,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.39736,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.41307,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.3209,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.46075,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.5103,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.52668,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.40149,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.43111,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.3209,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.07141,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01018,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00118,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.17175,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.12068,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.29532,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.62025,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.83829,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.95995,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.4603,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.53089,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackMathematicaRetrieval",
"type": "mteb/cqadupstack-mathematica",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.18944,
"verified": false
},
{
"type": "map_at_10",
"value": 0.29611,
"verified": false
},
{
"type": "map_at_100",
"value": 0.31063,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.31174,
"verified": false
},
{
"type": "map_at_3",
"value": 0.26098,
"verified": false
},
{
"type": "map_at_5",
"value": 0.28151,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.23756,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.34491,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.35457,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.35512,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.3126,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.3317,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.23756,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.36015,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.42175,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.44607,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.29725,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.32879,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.23756,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.06928,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01153,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00149,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.14635,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.1107,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.18944,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.50691,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.76503,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.93624,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.33611,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.41427,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackPhysicsRetrieval",
"type": "mteb/cqadupstack-physics",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.33824,
"verified": false
},
{
"type": "map_at_10",
"value": 0.46868,
"verified": false
},
{
"type": "map_at_100",
"value": 0.48306,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.48406,
"verified": false
},
{
"type": "map_at_3",
"value": 0.43335,
"verified": false
},
{
"type": "map_at_5",
"value": 0.45279,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.42348,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.52972,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.53707,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.53734,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.50722,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.52012,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.42348,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.53504,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.58899,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.60323,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.48478,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.5079,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.42348,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.0975,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01466,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00177,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.23741,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.16439,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.33824,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.67142,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.89134,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.97816,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.52305,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.58804,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackProgrammersRetrieval",
"type": "mteb/cqadupstack-programmers",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.30125,
"verified": false
},
{
"type": "map_at_10",
"value": 0.42119,
"verified": false
},
{
"type": "map_at_100",
"value": 0.43599,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.4369,
"verified": false
},
{
"type": "map_at_3",
"value": 0.38018,
"verified": false
},
{
"type": "map_at_5",
"value": 0.40368,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.37557,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.47573,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.4846,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.48499,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.44654,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.4644,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.37557,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.48743,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.54458,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.56076,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.42573,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.45528,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.37557,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.09269,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01401,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.0017,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.20624,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.15068,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.30125,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.62619,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.86574,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.97102,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.45437,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.53197,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackStatsRetrieval",
"type": "mteb/cqadupstack-stats",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.29193,
"verified": false
},
{
"type": "map_at_10",
"value": 0.37529,
"verified": false
},
{
"type": "map_at_100",
"value": 0.38614,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.38714,
"verified": false
},
{
"type": "map_at_3",
"value": 0.34897,
"verified": false
},
{
"type": "map_at_5",
"value": 0.36273,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.32669,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.40288,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.41177,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.41241,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.38037,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.39195,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.32669,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.42353,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.47424,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.4959,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.37604,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.39682,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.32669,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.06871,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01008,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00126,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.16309,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.11288,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.29193,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.54159,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.77267,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.92805,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.41014,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.46248,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackTexRetrieval",
"type": "mteb/cqadupstack-tex",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.21217,
"verified": false
},
{
"type": "map_at_10",
"value": 0.30848,
"verified": false
},
{
"type": "map_at_100",
"value": 0.32173,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.32296,
"verified": false
},
{
"type": "map_at_3",
"value": 0.27882,
"verified": false
},
{
"type": "map_at_5",
"value": 0.29537,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.25946,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.35091,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.36047,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.36111,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.32485,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.33964,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.25946,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.3655,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.42328,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.44783,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.31463,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.33803,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.25946,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.06793,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01138,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00155,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.1513,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.10991,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.21217,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.49327,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.7472,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.91637,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.34993,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.41029,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackUnixRetrieval",
"type": "mteb/cqadupstack-unix",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.34303,
"verified": false
},
{
"type": "map_at_10",
"value": 0.45312,
"verified": false
},
{
"type": "map_at_100",
"value": 0.46563,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.4664,
"verified": false
},
{
"type": "map_at_3",
"value": 0.4143,
"verified": false
},
{
"type": "map_at_5",
"value": 0.43633,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.40112,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.49097,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.49966,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.50006,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.46129,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.47901,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.40112,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.513,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.56534,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.58048,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.4491,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.48048,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.40112,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.08806,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01266,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00149,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.20211,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.14496,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.34303,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.65508,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.8753,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.9742,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.48465,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.56374,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackWebmastersRetrieval",
"type": "mteb/cqadupstack-webmasters",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.30312,
"verified": false
},
{
"type": "map_at_10",
"value": 0.40931,
"verified": false
},
{
"type": "map_at_100",
"value": 0.42893,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.4312,
"verified": false
},
{
"type": "map_at_3",
"value": 0.37527,
"verified": false
},
{
"type": "map_at_5",
"value": 0.3936,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.36364,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.45677,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.46753,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.46787,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.42918,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.4443,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.36364,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.47301,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.53698,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.55503,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.41875,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.44316,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.36364,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.09032,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01806,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00258,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.19499,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.1415,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.30312,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.59418,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.8656,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.97412,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.44251,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.50457,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB CQADupstackWordpressRetrieval",
"type": "mteb/cqadupstack-wordpress",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.23851,
"verified": false
},
{
"type": "map_at_10",
"value": 0.33429,
"verified": false
},
{
"type": "map_at_100",
"value": 0.34482,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.3457,
"verified": false
},
{
"type": "map_at_3",
"value": 0.30271,
"verified": false
},
{
"type": "map_at_5",
"value": 0.31905,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.25693,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.35383,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.36295,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.36346,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.32532,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.3402,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.25693,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.39196,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.44501,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.46482,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.33,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.35736,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.25693,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.06433,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.00989,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00128,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.14295,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.10277,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.23851,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.55036,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.79592,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.94283,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.38435,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.44872,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB DBPedia",
"type": "mteb/dbpedia",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.0871,
"verified": false
},
{
"type": "map_at_10",
"value": 0.19218,
"verified": false
},
{
"type": "map_at_100",
"value": 0.26291,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.27985,
"verified": false
},
{
"type": "map_at_3",
"value": 0.13974,
"verified": false
},
{
"type": "map_at_5",
"value": 0.16104,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.6725,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.75037,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.75318,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.75325,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.73833,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.74308,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.54375,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.39409,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.44382,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.52485,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.44463,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.41276,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.6725,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.3055,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.09588,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.02118,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.48167,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.394,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.0871,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.2527,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.5185,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.76491,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.15516,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.18907,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB FEVER",
"type": "mteb/fever",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.78993,
"verified": false
},
{
"type": "map_at_10",
"value": 0.8502,
"verified": false
},
{
"type": "map_at_100",
"value": 0.85186,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.852,
"verified": false
},
{
"type": "map_at_3",
"value": 0.8437,
"verified": false
},
{
"type": "map_at_5",
"value": 0.84812,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.85179,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.90744,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.90799,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.90801,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.90322,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.90622,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.85179,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.88229,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.8884,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.89116,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.87304,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.87862,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.85179,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.10129,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.0106,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.0011,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.32543,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.19931,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.78993,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.92685,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.9516,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.96943,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.89965,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.91562,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB FiQA2018",
"type": "mteb/fiqa",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.22586,
"verified": false
},
{
"type": "map_at_10",
"value": 0.36836,
"verified": false
},
{
"type": "map_at_100",
"value": 0.38863,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.39041,
"verified": false
},
{
"type": "map_at_3",
"value": 0.32445,
"verified": false
},
{
"type": "map_at_5",
"value": 0.34951,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.44599,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.53471,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.54186,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.54223,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.51157,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.52423,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.44599,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.44931,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.51914,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.54674,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.41597,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.42611,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.44599,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.12346,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01951,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00244,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.27623,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.20093,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.22586,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.5152,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.77251,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.93503,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.37802,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.4386,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB HotpotQA",
"type": "mteb/hotpotqa",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.38177,
"verified": false
},
{
"type": "map_at_10",
"value": 0.59021,
"verified": false
},
{
"type": "map_at_100",
"value": 0.59924,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.59989,
"verified": false
},
{
"type": "map_at_3",
"value": 0.55553,
"verified": false
},
{
"type": "map_at_5",
"value": 0.57773,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.76354,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.827,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.82887,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.82896,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.8172,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.82338,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.76354,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.67775,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.70849,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.7215,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.629,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.65679,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.76354,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.14176,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01656,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00183,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.40113,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.26255,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.38177,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.70878,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.82822,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.91472,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.60169,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.65638,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB MSMARCO",
"type": "mteb/msmarco",
"config": "default",
"split": "dev"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.15062,
"verified": false
},
{
"type": "map_at_10",
"value": 0.26008,
"verified": false
},
{
"type": "map_at_100",
"value": 0.27305,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.27373,
"verified": false
},
{
"type": "map_at_3",
"value": 0.22236,
"verified": false
},
{
"type": "map_at_5",
"value": 0.24362,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.15444,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.26458,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.27718,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.2778,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.22701,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.24844,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.15444,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.32495,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.38957,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.40684,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.24745,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.2856,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.15444,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.05486,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.00875,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00102,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.1086,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.08441,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.15062,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.5272,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.83006,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.96263,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.31556,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.40706,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB NFCorpus",
"type": "mteb/nfcorpus",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.06126,
"verified": false
},
{
"type": "map_at_10",
"value": 0.14152,
"verified": false
},
{
"type": "map_at_100",
"value": 0.1827,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.1988,
"verified": false
},
{
"type": "map_at_3",
"value": 0.10301,
"verified": false
},
{
"type": "map_at_5",
"value": 0.12085,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.47988,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.5692,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.57428,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.57482,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.55315,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.56352,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.45356,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.3725,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.34496,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.43374,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.42643,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.40882,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.47368,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.2774,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.09071,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.02226,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.40144,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.35913,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.06126,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.18427,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.35018,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.6766,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.11706,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.14419,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB NQ",
"type": "mteb/nq",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.33053,
"verified": false
},
{
"type": "map_at_10",
"value": 0.49739,
"verified": false
},
{
"type": "map_at_100",
"value": 0.50626,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.50647,
"verified": false
},
{
"type": "map_at_3",
"value": 0.4491,
"verified": false
},
{
"type": "map_at_5",
"value": 0.4783,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.37254,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.52222,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.52855,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.52869,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.48445,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.50834,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.37254,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.58044,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.61613,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.62046,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.49219,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.54037,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.37254,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.09655,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01167,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00121,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.22538,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.16344,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.33053,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.8076,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.95862,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.99044,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.58157,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.69235,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB QuoraRetrieval",
"type": "mteb/quora",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.70056,
"verified": false
},
{
"type": "map_at_10",
"value": 0.84009,
"verified": false
},
{
"type": "map_at_100",
"value": 0.84661,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.84678,
"verified": false
},
{
"type": "map_at_3",
"value": 0.81036,
"verified": false
},
{
"type": "map_at_5",
"value": 0.82923,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.8062,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.86971,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.87079,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.8708,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.85943,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.86664,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.8064,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.87821,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.89091,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.89202,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.849,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.86544,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.8064,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.13347,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01527,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00157,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.37153,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.2448,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.70056,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.95148,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.99474,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.99977,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.86773,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.91396,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB SCIDOCS",
"type": "mteb/scidocs",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.05737,
"verified": false
},
{
"type": "map_at_10",
"value": 0.14896,
"verified": false
},
{
"type": "map_at_100",
"value": 0.17646,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.1803,
"verified": false
},
{
"type": "map_at_3",
"value": 0.10474,
"verified": false
},
{
"type": "map_at_5",
"value": 0.12656,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.281,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.39579,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.40687,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.40722,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.35917,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.38097,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.281,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.24146,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.339,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.39728,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.22721,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.20015,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.281,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.1254,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.02651,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00404,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.212,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.176,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.05737,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.254,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.53772,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.82013,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.12897,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.17855,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB SciFact",
"type": "mteb/scifact",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.60011,
"verified": false
},
{
"type": "map_at_10",
"value": 0.70101,
"verified": false
},
{
"type": "map_at_100",
"value": 0.70687,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.70699,
"verified": false
},
{
"type": "map_at_3",
"value": 0.67135,
"verified": false
},
{
"type": "map_at_5",
"value": 0.6878,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.62667,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.71022,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.71484,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.71496,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.68944,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.69961,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.62667,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.7472,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.76961,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.77294,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.69776,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.71964,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.62667,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.09933,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.01103,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.00113,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.27,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.178,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.60011,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.878,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.97333,
"verified": false
},
{
"type": "recall_at_1000",
"value": 1,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.74839,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.80028,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB Touche2020",
"type": "mteb/touche2020",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.02152,
"verified": false
},
{
"type": "map_at_10",
"value": 0.07747,
"verified": false
},
{
"type": "map_at_100",
"value": 0.1364,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.15235,
"verified": false
},
{
"type": "map_at_3",
"value": 0.04103,
"verified": false
},
{
"type": "map_at_5",
"value": 0.05482,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.26531,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.41399,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.43047,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.43047,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.38776,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.40612,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.23469,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.20147,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.3279,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.45324,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.22555,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.2097,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.26531,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.17755,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.07082,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.01547,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.2449,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.21633,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.02152,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.13331,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.4535,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.83447,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.05531,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.08029,
"verified": false
}
]
},
{
"task": {
"type": "Retrieval"
},
"dataset": {
"name": "MTEB TRECCOVID",
"type": "mteb/trec-covid",
"config": "default",
"split": "test"
},
"metrics": [
{
"type": "map_at_1",
"value": 0.00202,
"verified": false
},
{
"type": "map_at_10",
"value": 0.01727,
"verified": false
},
{
"type": "map_at_100",
"value": 0.10906,
"verified": false
},
{
"type": "map_at_1000",
"value": 0.2894,
"verified": false
},
{
"type": "map_at_3",
"value": 0.00553,
"verified": false
},
{
"type": "map_at_5",
"value": 0.00924,
"verified": false
},
{
"type": "mrr_at_1",
"value": 0.74,
"verified": false
},
{
"type": "mrr_at_10",
"value": 0.85667,
"verified": false
},
{
"type": "mrr_at_100",
"value": 0.85667,
"verified": false
},
{
"type": "mrr_at_1000",
"value": 0.85667,
"verified": false
},
{
"type": "mrr_at_3",
"value": 0.85667,
"verified": false
},
{
"type": "mrr_at_5",
"value": 0.85667,
"verified": false
},
{
"type": "ndcg_at_1",
"value": 0.66,
"verified": false
},
{
"type": "ndcg_at_10",
"value": 0.69259,
"verified": false
},
{
"type": "ndcg_at_100",
"value": 0.57274,
"verified": false
},
{
"type": "ndcg_at_1000",
"value": 0.55462,
"verified": false
},
{
"type": "ndcg_at_3",
"value": 0.70654,
"verified": false
},
{
"type": "ndcg_at_5",
"value": 0.71611,
"verified": false
},
{
"type": "precision_at_1",
"value": 0.74,
"verified": false
},
{
"type": "precision_at_10",
"value": 0.748,
"verified": false
},
{
"type": "precision_at_100",
"value": 0.5962,
"verified": false
},
{
"type": "precision_at_1000",
"value": 0.24842,
"verified": false
},
{
"type": "precision_at_3",
"value": 0.77333,
"verified": false
},
{
"type": "precision_at_5",
"value": 0.788,
"verified": false
},
{
"type": "recall_at_1",
"value": 0.00202,
"verified": false
},
{
"type": "recall_at_10",
"value": 0.02001,
"verified": false
},
{
"type": "recall_at_100",
"value": 0.14801,
"verified": false
},
{
"type": "recall_at_1000",
"value": 0.53939,
"verified": false
},
{
"type": "recall_at_3",
"value": 0.00609,
"verified": false
},
{
"type": "recall_at_5",
"value": 0.01048,
"verified": false
}
]
}
]
}
],
"frontmatter": {
"quantized_by": "bartowski",
"pipeline_tag": "text-generation",
"language": [
"en"
],
"tags": [
"language",
"granite",
"embeddings"
],
"license": "apache-2.0",
"base_model": [
"name: ibm-granite/granite-embedding-125m-english",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5",
"task:",
"type: map_at_1",
"type: map_at_10",
"type: map_at_100",
"type: map_at_1000",
"type: map_at_3",
"type: map_at_5",
"type: mrr_at_1",
"type: mrr_at_10",
"type: mrr_at_100",
"type: mrr_at_1000",
"type: mrr_at_3",
"type: mrr_at_5",
"type: ndcg_at_1",
"type: ndcg_at_10",
"type: ndcg_at_100",
"type: ndcg_at_1000",
"type: ndcg_at_3",
"type: ndcg_at_5",
"type: precision_at_1",
"type: precision_at_10",
"type: precision_at_100",
"type: precision_at_1000",
"type: precision_at_3",
"type: precision_at_5",
"type: recall_at_1",
"type: recall_at_10",
"type: recall_at_100",
"type: recall_at_1000",
"type: recall_at_3",
"type: recall_at_5"
]
},
"hero_image_url": "",
"summary": "",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nquantized_by: bartowski\npipeline_tag: text-generation\nlanguage:\n- en\ntags:\n- language\n- granite\n- embeddings\nlicense: apache-2.0\nbase_model: ibm-granite/granite-embedding-125m-english\nmodel-index:\n- name: ibm-granite/granite-embedding-125m-english\n results:\n - task:\n type: Retrieval\n dataset:\n name: MTEB ArguaAna\n type: mteb/arguana\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.33642\n - type: map_at_10\n value: 0.49716\n - type: map_at_100\n value: 0.50519\n - type: map_at_1000\n value: 0.50521\n - type: map_at_3\n value: 0.45057\n - type: map_at_5\n value: 0.47774\n - type: mrr_at_1\n value: 0.34922\n - type: mrr_at_10\n value: 0.50197\n - type: mrr_at_100\n value: 0.50992\n - type: mrr_at_1000\n value: 0.50994\n - type: mrr_at_3\n value: 0.45484\n - type: mrr_at_5\n value: 0.48272\n - type: ndcg_at_1\n value: 0.33642\n - type: ndcg_at_10\n value: 0.58401\n - type: ndcg_at_100\n value: 0.6157\n - type: ndcg_at_1000\n value: 0.61608\n - type: ndcg_at_3\n value: 0.48825\n - type: ndcg_at_5\n value: 0.53689\n - type: precision_at_1\n value: 0.33642\n - type: precision_at_10\n value: 0.08606\n - type: precision_at_100\n value: 0.00994\n - type: precision_at_1000\n value: 0.001\n - type: precision_at_3\n value: 0.19915\n - type: precision_at_5\n value: 0.14296\n - type: recall_at_1\n value: 0.33642\n - type: recall_at_10\n value: 0.8606\n - type: recall_at_100\n value: 0.9936\n - type: recall_at_1000\n value: 0.99644\n - type: recall_at_3\n value: 0.59744\n - type: recall_at_5\n value: 0.71479\n - task:\n type: Retrieval\n dataset:\n name: MTEB ClimateFEVER\n type: mteb/climate-fever\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.1457\n - type: map_at_10\n value: 0.24102\n - type: map_at_100\n value: 0.25826\n - type: map_at_1000\n value: 0.26021\n - type: map_at_3\n value: 0.20346\n - type: map_at_5\n value: 0.22228\n - type: mrr_at_1\n value: 0.32573\n - type: mrr_at_10\n value: 0.44411\n - type: mrr_at_100\n value: 0.45176\n - type: mrr_at_1000\n value: 0.45209\n - type: mrr_at_3\n value: 0.4126\n - type: mrr_at_5\n value: 0.43312\n - type: ndcg_at_1\n value: 0.32573\n - type: ndcg_at_10\n value: 0.3315\n - type: ndcg_at_100\n value: 0.39898\n - type: ndcg_at_1000\n value: 0.43151\n - type: ndcg_at_3\n value: 0.27683\n - type: ndcg_at_5\n value: 0.29538\n - type: precision_at_1\n value: 0.32573\n - type: precision_at_10\n value: 0.10176\n - type: precision_at_100\n value: 0.01754\n - type: precision_at_1000\n value: 0.00236\n - type: precision_at_3\n value: 0.20347\n - type: precision_at_5\n value: 0.15505\n - type: recall_at_1\n value: 0.1457\n - type: recall_at_10\n value: 0.38825\n - type: recall_at_100\n value: 0.62237\n - type: recall_at_1000\n value: 0.8022\n - type: recall_at_3\n value: 0.25245\n - type: recall_at_5\n value: 0.30821\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackAndroidRetrieval\n type: mteb/cqadupstack-android\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.36964\n - type: map_at_10\n value: 0.5043\n - type: map_at_100\n value: 0.52066\n - type: map_at_1000\n value: 0.52175\n - type: map_at_3\n value: 0.46001\n - type: map_at_5\n value: 0.48312\n - type: mrr_at_1\n value: 0.45923\n - type: mrr_at_10\n value: 0.56733\n - type: mrr_at_100\n value: 0.57292\n - type: mrr_at_1000\n value: 0.57321\n - type: mrr_at_3\n value: 0.54053\n - type: mrr_at_5\n value: 0.55556\n - type: ndcg_at_1\n value: 0.45923\n - type: ndcg_at_10\n value: 0.57667\n - type: ndcg_at_100\n value: 0.62373\n - type: ndcg_at_1000\n value: 0.6368\n - type: ndcg_at_3\n value: 0.51843\n - type: ndcg_at_5\n value: 0.54257\n - type: precision_at_1\n value: 0.45923\n - type: precision_at_10\n value: 0.11316\n - type: precision_at_100\n value: 0.01705\n - type: precision_at_1000\n value: 0.00216\n - type: precision_at_3\n value: 0.2537\n - type: precision_at_5\n value: 0.1814\n - type: recall_at_1\n value: 0.36964\n - type: recall_at_10\n value: 0.71234\n - type: recall_at_100\n value: 0.90421\n - type: recall_at_1000\n value: 0.98296\n - type: recall_at_3\n value: 0.53655\n - type: recall_at_5\n value: 0.60996\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackEnglishRetrieval\n type: mteb/cqadupstack-english\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.36198\n - type: map_at_10\n value: 0.49199\n - type: map_at_100\n value: 0.50602\n - type: map_at_1000\n value: 0.50736\n - type: map_at_3\n value: 0.45678\n - type: map_at_5\n value: 0.47605\n - type: mrr_at_1\n value: 0.45478\n - type: mrr_at_10\n value: 0.55075\n - type: mrr_at_100\n value: 0.55656\n - type: mrr_at_1000\n value: 0.55688\n - type: mrr_at_3\n value: 0.52887\n - type: mrr_at_5\n value: 0.54282\n - type: ndcg_at_1\n value: 0.45478\n - type: ndcg_at_10\n value: 0.55505\n - type: ndcg_at_100\n value: 0.59606\n - type: ndcg_at_1000\n value: 0.61255\n - type: ndcg_at_3\n value: 0.51124\n - type: ndcg_at_5\n value: 0.53166\n - type: precision_at_1\n value: 0.45478\n - type: precision_at_10\n value: 0.10752\n - type: precision_at_100\n value: 0.01666\n - type: precision_at_1000\n value: 0.00211\n - type: precision_at_3\n value: 0.25053\n - type: precision_at_5\n value: 0.17694\n - type: recall_at_1\n value: 0.36198\n - type: recall_at_10\n value: 0.66465\n - type: recall_at_100\n value: 0.83632\n - type: recall_at_1000\n value: 0.93276\n - type: recall_at_3\n value: 0.53207\n - type: recall_at_5\n value: 0.59169\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackGamingRetrieval\n type: mteb/cqadupstack-gaming\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.44157\n - type: map_at_10\n value: 0.57753\n - type: map_at_100\n value: 0.58698\n - type: map_at_1000\n value: 0.5874\n - type: map_at_3\n value: 0.54223\n - type: map_at_5\n value: 0.56307\n - type: mrr_at_1\n value: 0.50094\n - type: mrr_at_10\n value: 0.607\n - type: mrr_at_100\n value: 0.6126\n - type: mrr_at_1000\n value: 0.6128\n - type: mrr_at_3\n value: 0.58265\n - type: mrr_at_5\n value: 0.59817\n - type: ndcg_at_1\n value: 0.50094\n - type: ndcg_at_10\n value: 0.63641\n - type: ndcg_at_100\n value: 0.67055\n - type: ndcg_at_1000\n value: 0.67855\n - type: ndcg_at_3\n value: 0.58022\n - type: ndcg_at_5\n value: 0.6097\n - type: precision_at_1\n value: 0.50094\n - type: precision_at_10\n value: 0.10182\n - type: precision_at_100\n value: 0.01278\n - type: precision_at_1000\n value: 0.00138\n - type: precision_at_3\n value: 0.2581\n - type: precision_at_5\n value: 0.17755\n - type: recall_at_1\n value: 0.44157\n - type: recall_at_10\n value: 0.7778\n - type: recall_at_100\n value: 0.92244\n - type: recall_at_1000\n value: 0.9781\n - type: recall_at_3\n value: 0.63087\n - type: recall_at_5\n value: 0.70172\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackGisRetrieval\n type: mteb/cqadupstack-gis\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.29532\n - type: map_at_10\n value: 0.40214\n - type: map_at_100\n value: 0.41289\n - type: map_at_1000\n value: 0.41359\n - type: map_at_3\n value: 0.37086\n - type: map_at_5\n value: 0.38889\n - type: mrr_at_1\n value: 0.3209\n - type: mrr_at_10\n value: 0.42423\n - type: mrr_at_100\n value: 0.43342\n - type: mrr_at_1000\n value: 0.43395\n - type: mrr_at_3\n value: 0.39736\n - type: mrr_at_5\n value: 0.41307\n - type: ndcg_at_1\n value: 0.3209\n - type: ndcg_at_10\n value: 0.46075\n - type: ndcg_at_100\n value: 0.5103\n - type: ndcg_at_1000\n value: 0.52668\n - type: ndcg_at_3\n value: 0.40149\n - type: ndcg_at_5\n value: 0.43111\n - type: precision_at_1\n value: 0.3209\n - type: precision_at_10\n value: 0.07141\n - type: precision_at_100\n value: 0.01018\n - type: precision_at_1000\n value: 0.00118\n - type: precision_at_3\n value: 0.17175\n - type: precision_at_5\n value: 0.12068\n - type: recall_at_1\n value: 0.29532\n - type: recall_at_10\n value: 0.62025\n - type: recall_at_100\n value: 0.83829\n - type: recall_at_1000\n value: 0.95995\n - type: recall_at_3\n value: 0.4603\n - type: recall_at_5\n value: 0.53089\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackMathematicaRetrieval\n type: mteb/cqadupstack-mathematica\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.18944\n - type: map_at_10\n value: 0.29611\n - type: map_at_100\n value: 0.31063\n - type: map_at_1000\n value: 0.31174\n - type: map_at_3\n value: 0.26098\n - type: map_at_5\n value: 0.28151\n - type: mrr_at_1\n value: 0.23756\n - type: mrr_at_10\n value: 0.34491\n - type: mrr_at_100\n value: 0.35457\n - type: mrr_at_1000\n value: 0.35512\n - type: mrr_at_3\n value: 0.3126\n - type: mrr_at_5\n value: 0.3317\n - type: ndcg_at_1\n value: 0.23756\n - type: ndcg_at_10\n value: 0.36015\n - type: ndcg_at_100\n value: 0.42175\n - type: ndcg_at_1000\n value: 0.44607\n - type: ndcg_at_3\n value: 0.29725\n - type: ndcg_at_5\n value: 0.32879\n - type: precision_at_1\n value: 0.23756\n - type: precision_at_10\n value: 0.06928\n - type: precision_at_100\n value: 0.01153\n - type: precision_at_1000\n value: 0.00149\n - type: precision_at_3\n value: 0.14635\n - type: precision_at_5\n value: 0.1107\n - type: recall_at_1\n value: 0.18944\n - type: recall_at_10\n value: 0.50691\n - type: recall_at_100\n value: 0.76503\n - type: recall_at_1000\n value: 0.93624\n - type: recall_at_3\n value: 0.33611\n - type: recall_at_5\n value: 0.41427\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackPhysicsRetrieval\n type: mteb/cqadupstack-physics\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.33824\n - type: map_at_10\n value: 0.46868\n - type: map_at_100\n value: 0.48306\n - type: map_at_1000\n value: 0.48406\n - type: map_at_3\n value: 0.43335\n - type: map_at_5\n value: 0.45279\n - type: mrr_at_1\n value: 0.42348\n - type: mrr_at_10\n value: 0.52972\n - type: mrr_at_100\n value: 0.53707\n - type: mrr_at_1000\n value: 0.53734\n - type: mrr_at_3\n value: 0.50722\n - type: mrr_at_5\n value: 0.52012\n - type: ndcg_at_1\n value: 0.42348\n - type: ndcg_at_10\n value: 0.53504\n - type: ndcg_at_100\n value: 0.58899\n - type: ndcg_at_1000\n value: 0.60323\n - type: ndcg_at_3\n value: 0.48478\n - type: ndcg_at_5\n value: 0.5079\n - type: precision_at_1\n value: 0.42348\n - type: precision_at_10\n value: 0.0975\n - type: precision_at_100\n value: 0.01466\n - type: precision_at_1000\n value: 0.00177\n - type: precision_at_3\n value: 0.23741\n - type: precision_at_5\n value: 0.16439\n - type: recall_at_1\n value: 0.33824\n - type: recall_at_10\n value: 0.67142\n - type: recall_at_100\n value: 0.89134\n - type: recall_at_1000\n value: 0.97816\n - type: recall_at_3\n value: 0.52305\n - type: recall_at_5\n value: 0.58804\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackProgrammersRetrieval\n type: mteb/cqadupstack-programmers\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.30125\n - type: map_at_10\n value: 0.42119\n - type: map_at_100\n value: 0.43599\n - type: map_at_1000\n value: 0.4369\n - type: map_at_3\n value: 0.38018\n - type: map_at_5\n value: 0.40368\n - type: mrr_at_1\n value: 0.37557\n - type: mrr_at_10\n value: 0.47573\n - type: mrr_at_100\n value: 0.4846\n - type: mrr_at_1000\n value: 0.48499\n - type: mrr_at_3\n value: 0.44654\n - type: mrr_at_5\n value: 0.4644\n - type: ndcg_at_1\n value: 0.37557\n - type: ndcg_at_10\n value: 0.48743\n - type: ndcg_at_100\n value: 0.54458\n - type: ndcg_at_1000\n value: 0.56076\n - type: ndcg_at_3\n value: 0.42573\n - type: ndcg_at_5\n value: 0.45528\n - type: precision_at_1\n value: 0.37557\n - type: precision_at_10\n value: 0.09269\n - type: precision_at_100\n value: 0.01401\n - type: precision_at_1000\n value: 0.0017\n - type: precision_at_3\n value: 0.20624\n - type: precision_at_5\n value: 0.15068\n - type: recall_at_1\n value: 0.30125\n - type: recall_at_10\n value: 0.62619\n - type: recall_at_100\n value: 0.86574\n - type: recall_at_1000\n value: 0.97102\n - type: recall_at_3\n value: 0.45437\n - type: recall_at_5\n value: 0.53197\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackStatsRetrieval\n type: mteb/cqadupstack-stats\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.29193\n - type: map_at_10\n value: 0.37529\n - type: map_at_100\n value: 0.38614\n - type: map_at_1000\n value: 0.38714\n - type: map_at_3\n value: 0.34897\n - type: map_at_5\n value: 0.36273\n - type: mrr_at_1\n value: 0.32669\n - type: mrr_at_10\n value: 0.40288\n - type: mrr_at_100\n value: 0.41177\n - type: mrr_at_1000\n value: 0.41241\n - type: mrr_at_3\n value: 0.38037\n - type: mrr_at_5\n value: 0.39195\n - type: ndcg_at_1\n value: 0.32669\n - type: ndcg_at_10\n value: 0.42353\n - type: ndcg_at_100\n value: 0.47424\n - type: ndcg_at_1000\n value: 0.4959\n - type: ndcg_at_3\n value: 0.37604\n - type: ndcg_at_5\n value: 0.39682\n - type: precision_at_1\n value: 0.32669\n - type: precision_at_10\n value: 0.06871\n - type: precision_at_100\n value: 0.01008\n - type: precision_at_1000\n value: 0.00126\n - type: precision_at_3\n value: 0.16309\n - type: precision_at_5\n value: 0.11288\n - type: recall_at_1\n value: 0.29193\n - type: recall_at_10\n value: 0.54159\n - type: recall_at_100\n value: 0.77267\n - type: recall_at_1000\n value: 0.92805\n - type: recall_at_3\n value: 0.41014\n - type: recall_at_5\n value: 0.46248\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackTexRetrieval\n type: mteb/cqadupstack-tex\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.21217\n - type: map_at_10\n value: 0.30848\n - type: map_at_100\n value: 0.32173\n - type: map_at_1000\n value: 0.32296\n - type: map_at_3\n value: 0.27882\n - type: map_at_5\n value: 0.29537\n - type: mrr_at_1\n value: 0.25946\n - type: mrr_at_10\n value: 0.35091\n - type: mrr_at_100\n value: 0.36047\n - type: mrr_at_1000\n value: 0.36111\n - type: mrr_at_3\n value: 0.32485\n - type: mrr_at_5\n value: 0.33964\n - type: ndcg_at_1\n value: 0.25946\n - type: ndcg_at_10\n value: 0.3655\n - type: ndcg_at_100\n value: 0.42328\n - type: ndcg_at_1000\n value: 0.44783\n - type: ndcg_at_3\n value: 0.31463\n - type: ndcg_at_5\n value: 0.33803\n - type: precision_at_1\n value: 0.25946\n - type: precision_at_10\n value: 0.06793\n - type: precision_at_100\n value: 0.01138\n - type: precision_at_1000\n value: 0.00155\n - type: precision_at_3\n value: 0.1513\n - type: precision_at_5\n value: 0.10991\n - type: recall_at_1\n value: 0.21217\n - type: recall_at_10\n value: 0.49327\n - type: recall_at_100\n value: 0.7472\n - type: recall_at_1000\n value: 0.91637\n - type: recall_at_3\n value: 0.34993\n - type: recall_at_5\n value: 0.41029\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackUnixRetrieval\n type: mteb/cqadupstack-unix\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.34303\n - type: map_at_10\n value: 0.45312\n - type: map_at_100\n value: 0.46563\n - type: map_at_1000\n value: 0.4664\n - type: map_at_3\n value: 0.4143\n - type: map_at_5\n value: 0.43633\n - type: mrr_at_1\n value: 0.40112\n - type: mrr_at_10\n value: 0.49097\n - type: mrr_at_100\n value: 0.49966\n - type: mrr_at_1000\n value: 0.50006\n - type: mrr_at_3\n value: 0.46129\n - type: mrr_at_5\n value: 0.47901\n - type: ndcg_at_1\n value: 0.40112\n - type: ndcg_at_10\n value: 0.513\n - type: ndcg_at_100\n value: 0.56534\n - type: ndcg_at_1000\n value: 0.58048\n - type: ndcg_at_3\n value: 0.4491\n - type: ndcg_at_5\n value: 0.48048\n - type: precision_at_1\n value: 0.40112\n - type: precision_at_10\n value: 0.08806\n - type: precision_at_100\n value: 0.01266\n - type: precision_at_1000\n value: 0.00149\n - type: precision_at_3\n value: 0.20211\n - type: precision_at_5\n value: 0.14496\n - type: recall_at_1\n value: 0.34303\n - type: recall_at_10\n value: 0.65508\n - type: recall_at_100\n value: 0.8753\n - type: recall_at_1000\n value: 0.9742\n - type: recall_at_3\n value: 0.48465\n - type: recall_at_5\n value: 0.56374\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackWebmastersRetrieval\n type: mteb/cqadupstack-webmasters\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.30312\n - type: map_at_10\n value: 0.40931\n - type: map_at_100\n value: 0.42893\n - type: map_at_1000\n value: 0.4312\n - type: map_at_3\n value: 0.37527\n - type: map_at_5\n value: 0.3936\n - type: mrr_at_1\n value: 0.36364\n - type: mrr_at_10\n value: 0.45677\n - type: mrr_at_100\n value: 0.46753\n - type: mrr_at_1000\n value: 0.46787\n - type: mrr_at_3\n value: 0.42918\n - type: mrr_at_5\n value: 0.4443\n - type: ndcg_at_1\n value: 0.36364\n - type: ndcg_at_10\n value: 0.47301\n - type: ndcg_at_100\n value: 0.53698\n - type: ndcg_at_1000\n value: 0.55503\n - type: ndcg_at_3\n value: 0.41875\n - type: ndcg_at_5\n value: 0.44316\n - type: precision_at_1\n value: 0.36364\n - type: precision_at_10\n value: 0.09032\n - type: precision_at_100\n value: 0.01806\n - type: precision_at_1000\n value: 0.00258\n - type: precision_at_3\n value: 0.19499\n - type: precision_at_5\n value: 0.1415\n - type: recall_at_1\n value: 0.30312\n - type: recall_at_10\n value: 0.59418\n - type: recall_at_100\n value: 0.8656\n - type: recall_at_1000\n value: 0.97412\n - type: recall_at_3\n value: 0.44251\n - type: recall_at_5\n value: 0.50457\n - task:\n type: Retrieval\n dataset:\n name: MTEB CQADupstackWordpressRetrieval\n type: mteb/cqadupstack-wordpress\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.23851\n - type: map_at_10\n value: 0.33429\n - type: map_at_100\n value: 0.34482\n - type: map_at_1000\n value: 0.3457\n - type: map_at_3\n value: 0.30271\n - type: map_at_5\n value: 0.31905\n - type: mrr_at_1\n value: 0.25693\n - type: mrr_at_10\n value: 0.35383\n - type: mrr_at_100\n value: 0.36295\n - type: mrr_at_1000\n value: 0.36346\n - type: mrr_at_3\n value: 0.32532\n - type: mrr_at_5\n value: 0.3402\n - type: ndcg_at_1\n value: 0.25693\n - type: ndcg_at_10\n value: 0.39196\n - type: ndcg_at_100\n value: 0.44501\n - type: ndcg_at_1000\n value: 0.46482\n - type: ndcg_at_3\n value: 0.33\n - type: ndcg_at_5\n value: 0.35736\n - type: precision_at_1\n value: 0.25693\n - type: precision_at_10\n value: 0.06433\n - type: precision_at_100\n value: 0.00989\n - type: precision_at_1000\n value: 0.00128\n - type: precision_at_3\n value: 0.14295\n - type: precision_at_5\n value: 0.10277\n - type: recall_at_1\n value: 0.23851\n - type: recall_at_10\n value: 0.55036\n - type: recall_at_100\n value: 0.79592\n - type: recall_at_1000\n value: 0.94283\n - type: recall_at_3\n value: 0.38435\n - type: recall_at_5\n value: 0.44872\n - task:\n type: Retrieval\n dataset:\n name: MTEB DBPedia\n type: mteb/dbpedia\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.0871\n - type: map_at_10\n value: 0.19218\n - type: map_at_100\n value: 0.26291\n - type: map_at_1000\n value: 0.27985\n - type: map_at_3\n value: 0.13974\n - type: map_at_5\n value: 0.16104\n - type: mrr_at_1\n value: 0.6725\n - type: mrr_at_10\n value: 0.75037\n - type: mrr_at_100\n value: 0.75318\n - type: mrr_at_1000\n value: 0.75325\n - type: mrr_at_3\n value: 0.73833\n - type: mrr_at_5\n value: 0.74308\n - type: ndcg_at_1\n value: 0.54375\n - type: ndcg_at_10\n value: 0.39409\n - type: ndcg_at_100\n value: 0.44382\n - type: ndcg_at_1000\n value: 0.52485\n - type: ndcg_at_3\n value: 0.44463\n - type: ndcg_at_5\n value: 0.41276\n - type: precision_at_1\n value: 0.6725\n - type: precision_at_10\n value: 0.3055\n - type: precision_at_100\n value: 0.09588\n - type: precision_at_1000\n value: 0.02118\n - type: precision_at_3\n value: 0.48167\n - type: precision_at_5\n value: 0.394\n - type: recall_at_1\n value: 0.0871\n - type: recall_at_10\n value: 0.2527\n - type: recall_at_100\n value: 0.5185\n - type: recall_at_1000\n value: 0.76491\n - type: recall_at_3\n value: 0.15516\n - type: recall_at_5\n value: 0.18907\n - task:\n type: Retrieval\n dataset:\n name: MTEB FEVER\n type: mteb/fever\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.78993\n - type: map_at_10\n value: 0.8502\n - type: map_at_100\n value: 0.85186\n - type: map_at_1000\n value: 0.852\n - type: map_at_3\n value: 0.8437\n - type: map_at_5\n value: 0.84812\n - type: mrr_at_1\n value: 0.85179\n - type: mrr_at_10\n value: 0.90744\n - type: mrr_at_100\n value: 0.90799\n - type: mrr_at_1000\n value: 0.90801\n - type: mrr_at_3\n value: 0.90322\n - type: mrr_at_5\n value: 0.90622\n - type: ndcg_at_1\n value: 0.85179\n - type: ndcg_at_10\n value: 0.88229\n - type: ndcg_at_100\n value: 0.8884\n - type: ndcg_at_1000\n value: 0.89116\n - type: ndcg_at_3\n value: 0.87304\n - type: ndcg_at_5\n value: 0.87862\n - type: precision_at_1\n value: 0.85179\n - type: precision_at_10\n value: 0.10129\n - type: precision_at_100\n value: 0.0106\n - type: precision_at_1000\n value: 0.0011\n - type: precision_at_3\n value: 0.32543\n - type: precision_at_5\n value: 0.19931\n - type: recall_at_1\n value: 0.78993\n - type: recall_at_10\n value: 0.92685\n - type: recall_at_100\n value: 0.9516\n - type: recall_at_1000\n value: 0.96943\n - type: recall_at_3\n value: 0.89965\n - type: recall_at_5\n value: 0.91562\n - task:\n type: Retrieval\n dataset:\n name: MTEB FiQA2018\n type: mteb/fiqa\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.22586\n - type: map_at_10\n value: 0.36836\n - type: map_at_100\n value: 0.38863\n - type: map_at_1000\n value: 0.39041\n - type: map_at_3\n value: 0.32445\n - type: map_at_5\n value: 0.34951\n - type: mrr_at_1\n value: 0.44599\n - type: mrr_at_10\n value: 0.53471\n - type: mrr_at_100\n value: 0.54186\n - type: mrr_at_1000\n value: 0.54223\n - type: mrr_at_3\n value: 0.51157\n - type: mrr_at_5\n value: 0.52423\n - type: ndcg_at_1\n value: 0.44599\n - type: ndcg_at_10\n value: 0.44931\n - type: ndcg_at_100\n value: 0.51914\n - type: ndcg_at_1000\n value: 0.54674\n - type: ndcg_at_3\n value: 0.41597\n - type: ndcg_at_5\n value: 0.42611\n - type: precision_at_1\n value: 0.44599\n - type: precision_at_10\n value: 0.12346\n - type: precision_at_100\n value: 0.01951\n - type: precision_at_1000\n value: 0.00244\n - type: precision_at_3\n value: 0.27623\n - type: precision_at_5\n value: 0.20093\n - type: recall_at_1\n value: 0.22586\n - type: recall_at_10\n value: 0.5152\n - type: recall_at_100\n value: 0.77251\n - type: recall_at_1000\n value: 0.93503\n - type: recall_at_3\n value: 0.37802\n - type: recall_at_5\n value: 0.4386\n - task:\n type: Retrieval\n dataset:\n name: MTEB HotpotQA\n type: mteb/hotpotqa\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.38177\n - type: map_at_10\n value: 0.59021\n - type: map_at_100\n value: 0.59924\n - type: map_at_1000\n value: 0.59989\n - type: map_at_3\n value: 0.55553\n - type: map_at_5\n value: 0.57773\n - type: mrr_at_1\n value: 0.76354\n - type: mrr_at_10\n value: 0.827\n - type: mrr_at_100\n value: 0.82887\n - type: mrr_at_1000\n value: 0.82896\n - type: mrr_at_3\n value: 0.8172\n - type: mrr_at_5\n value: 0.82338\n - type: ndcg_at_1\n value: 0.76354\n - type: ndcg_at_10\n value: 0.67775\n - type: ndcg_at_100\n value: 0.70849\n - type: ndcg_at_1000\n value: 0.7215\n - type: ndcg_at_3\n value: 0.629\n - type: ndcg_at_5\n value: 0.65679\n - type: precision_at_1\n value: 0.76354\n - type: precision_at_10\n value: 0.14176\n - type: precision_at_100\n value: 0.01656\n - type: precision_at_1000\n value: 0.00183\n - type: precision_at_3\n value: 0.40113\n - type: precision_at_5\n value: 0.26255\n - type: recall_at_1\n value: 0.38177\n - type: recall_at_10\n value: 0.70878\n - type: recall_at_100\n value: 0.82822\n - type: recall_at_1000\n value: 0.91472\n - type: recall_at_3\n value: 0.60169\n - type: recall_at_5\n value: 0.65638\n - task:\n type: Retrieval\n dataset:\n name: MTEB MSMARCO\n type: mteb/msmarco\n config: default\n split: dev\n metrics:\n - type: map_at_1\n value: 0.15062\n - type: map_at_10\n value: 0.26008\n - type: map_at_100\n value: 0.27305\n - type: map_at_1000\n value: 0.27373\n - type: map_at_3\n value: 0.22236\n - type: map_at_5\n value: 0.24362\n - type: mrr_at_1\n value: 0.15444\n - type: mrr_at_10\n value: 0.26458\n - type: mrr_at_100\n value: 0.27718\n - type: mrr_at_1000\n value: 0.2778\n - type: mrr_at_3\n value: 0.22701\n - type: mrr_at_5\n value: 0.24844\n - type: ndcg_at_1\n value: 0.15444\n - type: ndcg_at_10\n value: 0.32495\n - type: ndcg_at_100\n value: 0.38957\n - type: ndcg_at_1000\n value: 0.40684\n - type: ndcg_at_3\n value: 0.24745\n - type: ndcg_at_5\n value: 0.2856\n - type: precision_at_1\n value: 0.15444\n - type: precision_at_10\n value: 0.05486\n - type: precision_at_100\n value: 0.00875\n - type: precision_at_1000\n value: 0.00102\n - type: precision_at_3\n value: 0.1086\n - type: precision_at_5\n value: 0.08441\n - type: recall_at_1\n value: 0.15062\n - type: recall_at_10\n value: 0.5272\n - type: recall_at_100\n value: 0.83006\n - type: recall_at_1000\n value: 0.96263\n - type: recall_at_3\n value: 0.31556\n - type: recall_at_5\n value: 0.40706\n - task:\n type: Retrieval\n dataset:\n name: MTEB NFCorpus\n type: mteb/nfcorpus\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.06126\n - type: map_at_10\n value: 0.14152\n - type: map_at_100\n value: 0.1827\n - type: map_at_1000\n value: 0.1988\n - type: map_at_3\n value: 0.10301\n - type: map_at_5\n value: 0.12085\n - type: mrr_at_1\n value: 0.47988\n - type: mrr_at_10\n value: 0.5692\n - type: mrr_at_100\n value: 0.57428\n - type: mrr_at_1000\n value: 0.57482\n - type: mrr_at_3\n value: 0.55315\n - type: mrr_at_5\n value: 0.56352\n - type: ndcg_at_1\n value: 0.45356\n - type: ndcg_at_10\n value: 0.3725\n - type: ndcg_at_100\n value: 0.34496\n - type: ndcg_at_1000\n value: 0.43374\n - type: ndcg_at_3\n value: 0.42643\n - type: ndcg_at_5\n value: 0.40882\n - type: precision_at_1\n value: 0.47368\n - type: precision_at_10\n value: 0.2774\n - type: precision_at_100\n value: 0.09071\n - type: precision_at_1000\n value: 0.02226\n - type: precision_at_3\n value: 0.40144\n - type: precision_at_5\n value: 0.35913\n - type: recall_at_1\n value: 0.06126\n - type: recall_at_10\n value: 0.18427\n - type: recall_at_100\n value: 0.35018\n - type: recall_at_1000\n value: 0.6766\n - type: recall_at_3\n value: 0.11706\n - type: recall_at_5\n value: 0.14419\n - task:\n type: Retrieval\n dataset:\n name: MTEB NQ\n type: mteb/nq\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.33053\n - type: map_at_10\n value: 0.49739\n - type: map_at_100\n value: 0.50626\n - type: map_at_1000\n value: 0.50647\n - type: map_at_3\n value: 0.4491\n - type: map_at_5\n value: 0.4783\n - type: mrr_at_1\n value: 0.37254\n - type: mrr_at_10\n value: 0.52222\n - type: mrr_at_100\n value: 0.52855\n - type: mrr_at_1000\n value: 0.52869\n - type: mrr_at_3\n value: 0.48445\n - type: mrr_at_5\n value: 0.50834\n - type: ndcg_at_1\n value: 0.37254\n - type: ndcg_at_10\n value: 0.58044\n - type: ndcg_at_100\n value: 0.61613\n - type: ndcg_at_1000\n value: 0.62046\n - type: ndcg_at_3\n value: 0.49219\n - type: ndcg_at_5\n value: 0.54037\n - type: precision_at_1\n value: 0.37254\n - type: precision_at_10\n value: 0.09655\n - type: precision_at_100\n value: 0.01167\n - type: precision_at_1000\n value: 0.00121\n - type: precision_at_3\n value: 0.22538\n - type: precision_at_5\n value: 0.16344\n - type: recall_at_1\n value: 0.33053\n - type: recall_at_10\n value: 0.8076\n - type: recall_at_100\n value: 0.95862\n - type: recall_at_1000\n value: 0.99044\n - type: recall_at_3\n value: 0.58157\n - type: recall_at_5\n value: 0.69235\n - task:\n type: Retrieval\n dataset:\n name: MTEB QuoraRetrieval\n type: mteb/quora\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.70056\n - type: map_at_10\n value: 0.84009\n - type: map_at_100\n value: 0.84661\n - type: map_at_1000\n value: 0.84678\n - type: map_at_3\n value: 0.81036\n - type: map_at_5\n value: 0.82923\n - type: mrr_at_1\n value: 0.8062\n - type: mrr_at_10\n value: 0.86971\n - type: mrr_at_100\n value: 0.87079\n - type: mrr_at_1000\n value: 0.8708\n - type: mrr_at_3\n value: 0.85943\n - type: mrr_at_5\n value: 0.86664\n - type: ndcg_at_1\n value: 0.8064\n - type: ndcg_at_10\n value: 0.87821\n - type: ndcg_at_100\n value: 0.89091\n - type: ndcg_at_1000\n value: 0.89202\n - type: ndcg_at_3\n value: 0.849\n - type: ndcg_at_5\n value: 0.86544\n - type: precision_at_1\n value: 0.8064\n - type: precision_at_10\n value: 0.13347\n - type: precision_at_100\n value: 0.01527\n - type: precision_at_1000\n value: 0.00157\n - type: precision_at_3\n value: 0.37153\n - type: precision_at_5\n value: 0.2448\n - type: recall_at_1\n value: 0.70056\n - type: recall_at_10\n value: 0.95148\n - type: recall_at_100\n value: 0.99474\n - type: recall_at_1000\n value: 0.99977\n - type: recall_at_3\n value: 0.86773\n - type: recall_at_5\n value: 0.91396\n - task:\n type: Retrieval\n dataset:\n name: MTEB SCIDOCS\n type: mteb/scidocs\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.05737\n - type: map_at_10\n value: 0.14896\n - type: map_at_100\n value: 0.17646\n - type: map_at_1000\n value: 0.1803\n - type: map_at_3\n value: 0.10474\n - type: map_at_5\n value: 0.12656\n - type: mrr_at_1\n value: 0.281\n - type: mrr_at_10\n value: 0.39579\n - type: mrr_at_100\n value: 0.40687\n - type: mrr_at_1000\n value: 0.40722\n - type: mrr_at_3\n value: 0.35917\n - type: mrr_at_5\n value: 0.38097\n - type: ndcg_at_1\n value: 0.281\n - type: ndcg_at_10\n value: 0.24146\n - type: ndcg_at_100\n value: 0.339\n - type: ndcg_at_1000\n value: 0.39728\n - type: ndcg_at_3\n value: 0.22721\n - type: ndcg_at_5\n value: 0.20015\n - type: precision_at_1\n value: 0.281\n - type: precision_at_10\n value: 0.1254\n - type: precision_at_100\n value: 0.02651\n - type: precision_at_1000\n value: 0.00404\n - type: precision_at_3\n value: 0.212\n - type: precision_at_5\n value: 0.176\n - type: recall_at_1\n value: 0.05737\n - type: recall_at_10\n value: 0.254\n - type: recall_at_100\n value: 0.53772\n - type: recall_at_1000\n value: 0.82013\n - type: recall_at_3\n value: 0.12897\n - type: recall_at_5\n value: 0.17855\n - task:\n type: Retrieval\n dataset:\n name: MTEB SciFact\n type: mteb/scifact\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.60011\n - type: map_at_10\n value: 0.70101\n - type: map_at_100\n value: 0.70687\n - type: map_at_1000\n value: 0.70699\n - type: map_at_3\n value: 0.67135\n - type: map_at_5\n value: 0.6878\n - type: mrr_at_1\n value: 0.62667\n - type: mrr_at_10\n value: 0.71022\n - type: mrr_at_100\n value: 0.71484\n - type: mrr_at_1000\n value: 0.71496\n - type: mrr_at_3\n value: 0.68944\n - type: mrr_at_5\n value: 0.69961\n - type: ndcg_at_1\n value: 0.62667\n - type: ndcg_at_10\n value: 0.7472\n - type: ndcg_at_100\n value: 0.76961\n - type: ndcg_at_1000\n value: 0.77294\n - type: ndcg_at_3\n value: 0.69776\n - type: ndcg_at_5\n value: 0.71964\n - type: precision_at_1\n value: 0.62667\n - type: precision_at_10\n value: 0.09933\n - type: precision_at_100\n value: 0.01103\n - type: precision_at_1000\n value: 0.00113\n - type: precision_at_3\n value: 0.27\n - type: precision_at_5\n value: 0.178\n - type: recall_at_1\n value: 0.60011\n - type: recall_at_10\n value: 0.878\n - type: recall_at_100\n value: 0.97333\n - type: recall_at_1000\n value: 1\n - type: recall_at_3\n value: 0.74839\n - type: recall_at_5\n value: 0.80028\n - task:\n type: Retrieval\n dataset:\n name: MTEB Touche2020\n type: mteb/touche2020\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.02152\n - type: map_at_10\n value: 0.07747\n - type: map_at_100\n value: 0.1364\n - type: map_at_1000\n value: 0.15235\n - type: map_at_3\n value: 0.04103\n - type: map_at_5\n value: 0.05482\n - type: mrr_at_1\n value: 0.26531\n - type: mrr_at_10\n value: 0.41399\n - type: mrr_at_100\n value: 0.43047\n - type: mrr_at_1000\n value: 0.43047\n - type: mrr_at_3\n value: 0.38776\n - type: mrr_at_5\n value: 0.40612\n - type: ndcg_at_1\n value: 0.23469\n - type: ndcg_at_10\n value: 0.20147\n - type: ndcg_at_100\n value: 0.3279\n - type: ndcg_at_1000\n value: 0.45324\n - type: ndcg_at_3\n value: 0.22555\n - type: ndcg_at_5\n value: 0.2097\n - type: precision_at_1\n value: 0.26531\n - type: precision_at_10\n value: 0.17755\n - type: precision_at_100\n value: 0.07082\n - type: precision_at_1000\n value: 0.01547\n - type: precision_at_3\n value: 0.2449\n - type: precision_at_5\n value: 0.21633\n - type: recall_at_1\n value: 0.02152\n - type: recall_at_10\n value: 0.13331\n - type: recall_at_100\n value: 0.4535\n - type: recall_at_1000\n value: 0.83447\n - type: recall_at_3\n value: 0.05531\n - type: recall_at_5\n value: 0.08029\n - task:\n type: Retrieval\n dataset:\n name: MTEB TRECCOVID\n type: mteb/trec-covid\n config: default\n split: test\n metrics:\n - type: map_at_1\n value: 0.00202\n - type: map_at_10\n value: 0.01727\n - type: map_at_100\n value: 0.10906\n - type: map_at_1000\n value: 0.2894\n - type: map_at_3\n value: 0.00553\n - type: map_at_5\n value: 0.00924\n - type: mrr_at_1\n value: 0.74\n - type: mrr_at_10\n value: 0.85667\n - type: mrr_at_100\n value: 0.85667\n - type: mrr_at_1000\n value: 0.85667\n - type: mrr_at_3\n value: 0.85667\n - type: mrr_at_5\n value: 0.85667\n - type: ndcg_at_1\n value: 0.66\n - type: ndcg_at_10\n value: 0.69259\n - type: ndcg_at_100\n value: 0.57274\n - type: ndcg_at_1000\n value: 0.55462\n - type: ndcg_at_3\n value: 0.70654\n - type: ndcg_at_5\n value: 0.71611\n - type: precision_at_1\n value: 0.74\n - type: precision_at_10\n value: 0.748\n - type: precision_at_100\n value: 0.5962\n - type: precision_at_1000\n value: 0.24842\n - type: precision_at_3\n value: 0.77333\n - type: precision_at_5\n value: 0.788\n - type: recall_at_1\n value: 0.00202\n - type: recall_at_10\n value: 0.02001\n - type: recall_at_100\n value: 0.14801\n - type: recall_at_1000\n value: 0.53939\n - type: recall_at_3\n value: 0.00609\n - type: recall_at_5\n value: 0.01048\n---\n\n## Llamacpp Static Quantizations of granite-embedding-125m-english\n\nUsing <a href=\"https://github.com/ggerganov/llama.cpp/\">llama.cpp</a> release <a href=\"https://github.com/ggerganov/llama.cpp/releases/tag/b4381\">b4381</a> for quantization.\n\nOriginal model: https://huggingface.co/ibm-granite/granite-embedding-125m-english\n\nRun them in [LM Studio](https://lmstudio.ai/)\n\n## Prompt format\n\nNo prompt format found, check original model page\n\n## What's new:\n\nFix tokenizer\n\n## Download a file (not the whole branch) from below:\n\n| Filename | Quant type | File Size | Split | Description |\n| -------- | ---------- | --------- | ----- | ----------- |\n| [granite-embedding-125m-english-f16.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-f16.gguf) | f16 | 0.25GB | false | Full F16 weights. |\n| [granite-embedding-125m-english-Q8_0.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q8_0.gguf) | Q8_0 | 0.14GB | false | Extremely high quality, generally unneeded but max available quant. |\n| [granite-embedding-125m-english-Q6_K_L.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q6_K_L.gguf) | Q6_K_L | 0.11GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |\n| [granite-embedding-125m-english-Q6_K.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q6_K.gguf) | Q6_K | 0.11GB | false | Very high quality, near perfect, *recommended*. |\n| [granite-embedding-125m-english-Q5_K_L.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q5_K_L.gguf) | Q5_K_L | 0.11GB | false | Uses Q8_0 for embed and output weights. High quality, *recommended*. |\n| [granite-embedding-125m-english-Q5_K_M.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q5_K_M.gguf) | Q5_K_M | 0.10GB | false | High quality, *recommended*. |\n| [granite-embedding-125m-english-Q4_K_L.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q4_K_L.gguf) | Q4_K_L | 0.10GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |\n| [granite-embedding-125m-english-Q5_K_S.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q5_K_S.gguf) | Q5_K_S | 0.09GB | false | High quality, *recommended*. |\n| [granite-embedding-125m-english-Q4_K_M.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q4_K_M.gguf) | Q4_K_M | 0.09GB | false | Good quality, default size for most use cases, *recommended*. |\n| [granite-embedding-125m-english-Q3_K_XL.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q3_K_XL.gguf) | Q3_K_XL | 0.09GB | false | Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability. |\n| [granite-embedding-125m-english-Q4_K_S.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q4_K_S.gguf) | Q4_K_S | 0.08GB | false | Slightly lower quality with more space savings, *recommended*. |\n| [granite-embedding-125m-english-Q4_0.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q4_0.gguf) | Q4_0 | 0.08GB | false | Legacy format, offers online repacking for ARM and AVX CPU inference. |\n| [granite-embedding-125m-english-IQ4_NL.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-IQ4_NL.gguf) | IQ4_NL | 0.08GB | false | Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference. |\n| [granite-embedding-125m-english-IQ4_XS.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-IQ4_XS.gguf) | IQ4_XS | 0.08GB | false | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |\n| [granite-embedding-125m-english-Q3_K_L.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q3_K_L.gguf) | Q3_K_L | 0.08GB | false | Lower quality but usable, good for low RAM availability. |\n| [granite-embedding-125m-english-Q3_K_M.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-Q3_K_M.gguf) | Q3_K_M | 0.08GB | false | Low quality. |\n| [granite-embedding-125m-english-IQ3_M.gguf](https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF/blob/main/granite-embedding-125m-english-IQ3_M.gguf) | IQ3_M | 0.07GB | false | Medium-low quality, new method with decent performance comparable to Q3_K_M. |\n\n## Embed/output weights\n\nSome of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.\n\n## Downloading using huggingface-cli\n\n<details>\n <summary>Click to view download instructions</summary>\n\nFirst, make sure you have hugginface-cli installed:\n\n```\npip install -U \"huggingface_hub[cli]\"\n```\n\nThen, you can target the specific file you want:\n\n```\nhuggingface-cli download bartowski/granite-embedding-125m-english-GGUF --include \"granite-embedding-125m-english-Q4_K_M.gguf\" --local-dir ./\n```\n\nIf the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:\n\n```\nhuggingface-cli download bartowski/granite-embedding-125m-english-GGUF --include \"granite-embedding-125m-english-Q8_0/*\" --local-dir ./\n```\n\nYou can either specify a new local-dir (granite-embedding-125m-english-Q8_0) or download them all in place (./)\n\n</details>\n\n## ARM/AVX information\n\nPreviously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.\n\nNow, however, there is something called \"online repacking\" for weights. details in [this PR](https://github.com/ggerganov/llama.cpp/pull/9921). If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.\n\nAs of llama.cpp build [b4282](https://github.com/ggerganov/llama.cpp/releases/tag/b4282) you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.\n\nAdditionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to [this PR](https://github.com/ggerganov/llama.cpp/pull/10541) which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.\n\n<details>\n <summary>Click to view Q4_0_X_X information (deprecated</summary>\n\nI'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.\n\n<details>\n <summary>Click to view benchmarks on an AVX2 system (EPYC7702)</summary>\n\n| model | size | params | backend | threads | test | t/s | % (vs Q4_0) |\n| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |-------------: |\n| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp512 | 204.03 ± 1.03 | 100% |\n| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp1024 | 282.92 ± 0.19 | 100% |\n| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp2048 | 259.49 ± 0.44 | 100% |\n| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg128 | 39.12 ± 0.27 | 100% |\n| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg256 | 39.31 ± 0.69 | 100% |\n| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg512 | 40.52 ± 0.03 | 100% |\n| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp512 | 301.02 ± 1.74 | 147% |\n| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp1024 | 287.23 ± 0.20 | 101% |\n| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp2048 | 262.77 ± 1.81 | 101% |\n| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg128 | 18.80 ± 0.99 | 48% |\n| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg256 | 24.46 ± 3.04 | 83% |\n| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg512 | 36.32 ± 3.59 | 90% |\n| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp512 | 271.71 ± 3.53 | 133% |\n| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp1024 | 279.86 ± 45.63 | 100% |\n| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp2048 | 320.77 ± 5.00 | 124% |\n| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg128 | 43.51 ± 0.05 | 111% |\n| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg256 | 43.35 ± 0.09 | 110% |\n| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg512 | 42.60 ± 0.31 | 105% |\n\nQ4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation\n\n</details>\n\n</details>\n\n## Which file should I choose?\n\n<details>\n <summary>Click here for details</summary>\n\nA great write up with charts showing various performances is provided by Artefact2 [here](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)\n\nThe first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.\n\nIf you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.\n\nIf you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.\n\nNext, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.\n\nIf you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.\n\nIf you want to get more into the weeds, you can check out this extremely useful feature chart:\n\n[llama.cpp feature matrix](https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix)\n\nBut basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.\n\nThese I-quants can also be used on CPU and Apple Metal, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.\n\nThe I-quants are *not* compatible with Vulcan, which is also AMD, so if you have an AMD card double check if you're using the rocBLAS build or the Vulcan build. At the time of writing this, LM Studio has a preview with ROCm support, and other inference engines have specific builds for ROCm.\n\n</details>\n\n## Credits\n\nThank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.\n\nThank you ZeroWw for the inspiration to experiment with embed/output.\n\nWant to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski\n",
"related_quantizations": []
},
"tags": [
"gguf",
"language",
"granite",
"embeddings",
"text-generation",
"en",
"base_model:ibm-granite/granite-embedding-125m-english",
"base_model:quantized:ibm-granite/granite-embedding-125m-english",
"license:apache-2.0",
"model-index",
"endpoints_compatible",
"region:us",
"feature-extraction"
],
"likes": 0,
"downloads": 1131,
"gated": false,
"private": false,
"last_modified": "2024-12-23T04:59:17.000Z",
"created_at": "2024-12-18T16:52:22.000Z",
"pipeline_tag": "text-generation",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "6762fdc65263b0b1b2006fe5",
"id": "bartowski/granite-embedding-125m-english-GGUF",
"modelId": "bartowski/granite-embedding-125m-english-GGUF",
"sha": "4149d9619829382ae6e946621f4dfa5a11b31e34",
"createdAt": "2024-12-18T16:52:22.000Z",
"lastModified": "2024-12-23T04:59:17.000Z",
"author": "bartowski",
"downloads": 1131,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "",
"siblings_count": 19
}