GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

gcoli/whisper-large-v3-swiss-german-gguf-q4_0 overview

Whisper Large v3 Swiss German – GGUF Q4 0 Q4 0 quantized GGUF conversion of openai/whisper large v3 with the LoRA adapter Flurin17/whisper large v3 peft swiss …

transcribe.cppggufwhisperq4_0swiss-germanautomatic-speech-recognitiongswdebase_model:Flurin17/whisper-large-v3-peft-swiss-germanbase_model:quantized:Flurin17/whisper-large-v3-peft-swiss-germanlicense:otherregion:us

Runs locally from ~859.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
automatic-speech-recognition
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
whisper-large-v3-swiss-german-Q4_0.ggufGGUFQ4_0859.8 MBDownload

Model Details

Model IDgcoli/whisper-large-v3-swiss-german-gguf-q4_0
Authorgcoli
Pipelineautomatic-speech-recognition
Licenseother
Base modelopenai/whisper-large-v3,Flurin17/whisper-large-v3-peft-swiss-german
Last modified2026-08-13T19:32:52.000Z

Model README

---

library_name: transcribe.cpp

pipeline_tag: automatic-speech-recognition

license: other

license_name: swissdial-cc-by-nc-4.0-no-reidentification

license_link: https://form.jotform.com/223344961502048

language:

- gsw

- de

tags:

- gguf

- transcribe.cpp

- whisper

- q4_0

- swiss-german

- automatic-speech-recognition

base_model:

- openai/whisper-large-v3

- Flurin17/whisper-large-v3-peft-swiss-german

---

Whisper Large-v3 Swiss German – GGUF Q4_0

Q4_0-quantized GGUF conversion of openai/whisper-large-v3 with the LoRA

adapter Flurin17/whisper-large-v3-peft-swiss-german merged into the weights.

This is a standalone checkpoint for

handy-computer/transcribe.cpp.

Usage

ffmpeg -i input.m4a -ar 16000 -ac 1 input.wav

build/bin/transcribe-cli \
  -m whisper-large-v3-swiss-german-Q4_0.gguf \
  --language de \
  input.wav

For Swiss German transcription, de is the recommended Whisper language token

and transcribe is the intended task.

Format and compatibility

  • Format: GGUF Q4_0
  • Runtime: handy-computer/transcribe.cpp
  • Source quantization: the validated F16 GGUF variant
  • Not compatible with oMLX, which expects MLX Safetensors

Use

gcoli/whisper-large-v3-swiss-german-mlx-fp16

for oMLX.

Provenance

  • Base revision: 1ecca609f9a5ae2cd97a576a9725bc714c022a93
  • Adapter revision: 2ae117cf342bc57d6068066181a9d359e98a2961
  • transcribe.cpp converter and quantizer revision:

856d7c10a1a864b900e066b7c9801edf373f5148

  • Quantization preset: Q4_0

The adapter was merged into the base model in FP16. The resulting F16 GGUF was

then quantized using transcribe-quantize. Tokenizer, frontend and model

metadata remain embedded in the GGUF. quantization_provenance.json records

the exact F16 source checksum.

Evaluation and limitations

The build performs checksum validation and a real runtime transcription test.

Independent Swiss German WER and controlled performance comparisons between

F16, Q8_0 and Q4_0 have not yet been published. Q4_0 trades a smaller model and

lower memory demand for a potentially larger accuracy loss than Q8_0.

Whisper can hallucinate or omit text, particularly with noise, silence,

overlapping speakers, uncommon dialects, or specialized vocabulary. Do not use

its output as the sole basis for high-impact decisions.

License and usage conditions

SwissDial CC BY-NC 4.0 with no-reidentification condition

The Swiss German adaptation was trained on the

SwissDial dataset.

Use is limited to non-commercial purposes under CC BY-NC 4.0, attempts to

re-identify SwissDial speakers are prohibited, and SwissDial must be attributed

and cited in research use.

The Whisper base model remains subject to Apache-2.0. This repository grants no

additional rights to upstream models, training data, or software.

Run gcoli/whisper-large-v3-swiss-german-gguf-q4_0 with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models