GraySoft
Model Comparison

hugging-quants/llama-3.2-1b-instruct-q8_0-ggufvsmaziyarpanahi/wizardlm-2-7b-gguf

Side-by-side comparison of hugging-quants/llama-3.2-1b-instruct-q8_0-gguf and maziyarpanahi/wizardlm-2-7b-gguf: downloads, license, context length, tasks, and benchmarks.

hugging-quants/llama-3.2-1b-instruct-q8_0-gguf

hugging-quants · text-generation

This model was converted to GGUF format from meta-llama/Llama-3.2-1B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

maziyarpanahi/wizardlm-2-7b-gguf

MaziyarPanahi · text-generation

pip install llama-cpp-python # With NVidia CUDA acceleration CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python # Or with OpenBLAS acceleration CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install llama-cpp-python # Or with CLBLast acceleration CMAKE_AR…

Side-by-side Specifications

hugging-quants/llama-3.2-1b-instruct-q8_0-ggufmaziyarpanahi/wizardlm-2-7b-gguf
Authorhugging-quantsMaziyarPanahi
Pipeline Tasktext-generationtext-generation
Librarytransformers
Downloads850,44886,217
Likes4683
LicenseUnknownUnknown
Context Length
Created2024-09-252024-04-15
Last Modified2024-09-252024-04-15
Tags
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationen
transformersggufmistralquantized2-bit3-bit4-bit5-bit6-bit8-bit

View full details: hugging-quants/llama-3.2-1b-instruct-q8_0-gguf · maziyarpanahi/wizardlm-2-7b-gguf