GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

hacnho/gguf-add-bos-token-poc overview

GGUF add bos token PoC This repo is a benign security research PoC for Huntr MFV triage. Files: command r no bos.gguf verify remote poc.py Tested trigger entry…

ggufendpoints_compatibleregion:usconversational

Runs locally from ~10.4 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
command-r-no-bos.ggufGGUFGGUF10.4 MBDownload

Model Details

Model IDhacnho/gguf-add-bos-token-poc
Authorhacnho
Pipeline
License
Base model
Last modified2026-06-28T07:57:24.000Z

Model README

GGUF add_bos_token PoC

This repo is a benign security research PoC for Huntr MFV triage.

Files:

  • command-r-no-bos.gguf
  • verify_remote_poc.py

Tested trigger entrypoint:

  • llama-tokenize -m <model> --ids -p <prompt>

Behavior:

  • seed vocab-only GGUF uses tokenizer.ggml.add_bos_token = true
  • malicious artifact flips that metadata to false
  • ordinary prompt tokenization then silently drops the BOS token

Reproduction

python3 verify_remote_poc.py --repo hacnho/gguf-add-bos-token-poc

Expected output delta

Prompt:

hello world

Control token IDs:

[5, 34313, 3845]

Malicious token IDs:

[34313, 3845]

The same BOS-dropping behavior also appears on:

  • hello world
  • hello

Scanner posture

Local scout observed:

  • modelscan: No issues found on the malicious artifact

Run hacnho/gguf-add-bos-token-poc with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models