GraySoft
Model Comparison

felladrin/gguf-smollm-360m-instruct-add-basicsvsprism-ml/bonsai-8b-gguf

Side-by-side comparison of felladrin/gguf-smollm-360m-instruct-add-basics and prism-ml/bonsai-8b-gguf: downloads, license, context length, tasks, and benchmarks.

felladrin/gguf-smollm-360m-instruct-add-basics

Felladrin · —

GGUF version of HuggingFaceTB/smollm-360M-instruct-add-basics.

prism-ml/bonsai-8b-gguf

prism-ml · text-generation

End-to-end 1-bit language model for llama.cpp (CUDA, Metal, CPU) > **14.1x** smaller than FP16 | **6.2x** faster on RTX 4090 | **4-5x** lower energy/token

Side-by-side Specifications

felladrin/gguf-smollm-360m-instruct-add-basicsprism-ml/bonsai-8b-gguf
AuthorFelladrinprism-ml
Pipeline Tasktext-generation
Libraryllama.cpp
Downloads19,67883,309
Likes1618
LicenseUnknownUnknown
Context Length
Created2024-08-162026-03-18
Last Modified2024-08-162026-04-16
Tags
ggufbase_model:HuggingFaceTB/smollm-360M-instruct-add-basicsbase_model:quantized:HuggingFaceTB/smollm-360M-instruct-add-basicsendpoints_compatibleregion:usconversational
llama.cppgguf1-bitllama-cppcudametalon-deviceprismmlbonsaitext-generation

View full details: felladrin/gguf-smollm-360m-instruct-add-basics · prism-ml/bonsai-8b-gguf