qikp author hub
I took Abiray's F16 quantization https://huggingface.co/Abiray/MiniCPM5 1B GGUF , computed an imatrix using calibration data v3 https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8 . It was whatever Claude suggested. Then, I quantized it to a few formats. Enjoy
Models
2
Downloads
0
Run models locally with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.