GraySoft
Projects Models About FAQ Contact Download guIDE →
Model Intelligence Sheet

nexesenex/brucethemoose_yi-34b-200k-dare-megamerge-v8-imat.gguf overview

GGUF Quants with iMatrix for https://huggingface.co/brucethemoose/Yi-34B-200K-DARE-megamerge-v8 iMatrix made with 2500 batches of 32 tokens made on wiki.train.raw Benchs made with LlamaCPP :

ggufendpoints_compatibleregion:us
nexesenex/brucethemoose_yi-34b-200k-dare-megamerge-v8-imat.gguf visual
Downloads
226
Likes
4
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

11 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-2035-iMat-c32_ch2500-IQ2_XS.gguf GGUF IQ2_XS 9.60 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-2035-iMat-c32_ch2500-IQ3_XXS.gguf GGUF IQ3_XXS 12.74 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b1924-Q8_0.gguf GGUF 34.03 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-IQ4_NL.gguf GGUF IQ4_NL 18.18 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q2_K.gguf GGUF Q2_K 11.94 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q2_K_S.gguf GGUF Q2_K_S 11.04 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q3_K_S.gguf GGUF Q3_K_S 13.93 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf GGUF Q4_K_M 19.24 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b2251-iMat-c32_ch2500-IQ3_M.gguf GGUF IQ3_M 14.50 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b2254-iMat-c32_ch2500-IQ3_S.gguf GGUF IQ3_S 13.99 GB Download
brucethemoose_Yi-34B-200K-DARE-megamerge-v8-b2254-iMat-c32_ch2500-Q3_K_XS_v2.gguf GGUF Q3_K_XS_V 13.20 GB Download

Model Details Live

Model Slug
nexesenex/brucethemoose_yi-34b-200k-dare-megamerge-v8-imat.gguf
Author
Nexesenex
Pipeline Task
Library
Created
2024-01-23
Last Modified
2024-02-25
Gated
No
Private
No
HF SHA
3b2a374f80fc6bfcf1bfd2cc66841ada42e8fefc
License
Unknown
Language
Unknown
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "",
    "summary": "GGUF Quants with iMatrix for https://huggingface.co/brucethemoose/Yi-34B-200K-DARE-megamerge-v8 iMatrix made with 2500 batches of 32 tokens made on wiki.train.raw Benchs made with LlamaCPP :",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "GGUF Quants with iMatrix for https://huggingface.co/brucethemoose/Yi-34B-200K-DARE-megamerge-v8\n\niMatrix made with 2500 batches of 32 tokens made on wiki.train.raw\n\nBenchs made with LlamaCPP :\n\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Hellaswag,84.5,,400,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Hellaswag_Bin,79,,400,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Arc-Challenge,57.52508361,,299,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Arc-Easy,78.59649123,,570,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,MMLU,40.89456869,,313,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Thruthful-QA,34.76132191,,817,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Winogrande,77.9795,,1267,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,5.0681,512,512,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.5052,2048,2048,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.3656,4096,4096,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,\n- Yi-34B-200K-DARE-megamerge-v8-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.3190,8192,8192,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 4,
  "downloads": 226,
  "gated": false,
  "private": false,
  "last_modified": "2024-02-25T00:56:46.000Z",
  "created_at": "2024-01-23T21:54:18.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "65b0358ac11502dcf17006f7",
  "id": "Nexesenex/brucethemoose_Yi-34B-200K-DARE-megamerge-v8-iMat.GGUF",
  "modelId": "Nexesenex/brucethemoose_Yi-34B-200K-DARE-megamerge-v8-iMat.GGUF",
  "sha": "3b2a374f80fc6bfcf1bfd2cc66841ada42e8fefc",
  "createdAt": "2024-01-23T21:54:18.000Z",
  "lastModified": "2024-02-25T00:56:46.000Z",
  "author": "Nexesenex",
  "downloads": 226,
  "likes": 4,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 14
}