GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

cstr/distil-large-v3-GGUF overview

Distil Whisper Large v3 ggml ggml conversion of distil whisper/distil large v3 https://huggingface.co/distil whisper/distil large v3 for use with CrispASR http…

ggufggmlaudiospeech-recognitionwhisperdistil-whisperautomatic-speech-recognitionenbase_model:distil-whisper/distil-large-v3base_model:finetune:distil-whisper/distil-large-v3license:mitregion:us
Downloads
0
Likes
0
Pipeline
automatic-speech-recognition
Author

Repository Files & Downloads

0 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Browse files on Hugging Face

Model Details

Model IDcstr/distil-large-v3-GGUF
Authorcstr
Pipelineautomatic-speech-recognition
Licensemit
Base modeldistil-whisper/distil-large-v3
Last modified2026-08-02T15:21:45.000Z

Model README

---

license: mit

language:

  • en

tags:

  • gguf
  • ggml
  • audio
  • speech-recognition
  • whisper
  • distil-whisper
  • automatic-speech-recognition

base_model: distil-whisper/distil-large-v3

pipeline_tag: automatic-speech-recognition

---

Distil Whisper Large v3 (ggml)

ggml conversion of distil-whisper/distil-large-v3 for use with CrispASR and whisper.cpp.

Model Details

  • Architecture: Whisper encoder (32 layers, 1280-dim) + distilled decoder (2 layers only)
  • Parameters: 756M (49% smaller than whisper-large-v3)
  • Speed: 6.3x faster than whisper-large-v3, within 1% WER
  • Language: English
  • License: MIT

Usage

# Uses the standard whisper backend (auto-detected)
crispasr -m distil-large-v3-q5_0.bin -f audio.wav

Files

| File | Size | JFK Result |

|------|------|-----------|

| distil-large-v3.bin | 1.5 GB | perfect |

| distil-large-v3-q5_0.bin | 513 MB | perfect |

Why Distil Whisper?

  • 6.3x faster than whisper-large-v3 (2 decoder layers vs 32)
  • Within 1% WER on standard benchmarks
  • Same encoder as whisper-large-v3 (32 layers, 1280-dim)
  • Drop-in replacement — same ggml format, same CLI flags

Provenance and EU AI Act Art. 53 note

  • Upstream model: distil-whisper/distil-large-v3 — published by distil-whisper.
  • Upstream licence: mit. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
  • What was done here: format conversion and/or quantisation only (GGUF/GGML). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
  • Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
  • Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.

Run cstr/distil-large-v3-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models