GraySoft
Model Comparison

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufvsmaziyarpanahi/wizardlm-2-7b-gguf

Side-by-side comparison of hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf and maziyarpanahi/wizardlm-2-7b-gguf: downloads, license, context length, tasks, and benchmarks.

hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf

hugging-quants · text-generation

This model was converted to GGUF format from meta-llama/Llama-3.2-3B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

maziyarpanahi/wizardlm-2-7b-gguf

MaziyarPanahi · text-generation

pip install llama-cpp-python # With NVidia CUDA acceleration CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python # Or with OpenBLAS acceleration CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install llama-cpp-python # Or with CLBLast acceleration CMAKE_AR…

Side-by-side Specifications

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufmaziyarpanahi/wizardlm-2-7b-gguf
Authorhugging-quantsMaziyarPanahi
Pipeline Tasktext-generationtext-generation
Librarytransformers
Downloads23,87586,217
Likes2783
LicenseUnknownUnknown
Context Length
Created2024-09-252024-04-15
Last Modified2024-09-252024-04-15
Tags
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationen
transformersggufmistralquantized2-bit3-bit4-bit5-bit6-bit8-bit

View full details: hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf · maziyarpanahi/wizardlm-2-7b-gguf