GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

dhilipsiva/dhilipsiva-twin-gguf overview

dhilipsiva twin — on device persona models LoRA fine tunes that impersonate dhilipsiva https://dhilipsiva.dev — they ARE his website: served into the visitor's…

ggufpersonacandlewebassemblychatmlenbase_model:HuggingFaceTB/SmolLM2-135M-Instructbase_model:quantized:HuggingFaceTB/SmolLM2-135M-Instructlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~138.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
490
Likes
0
Pipeline

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
dhilipsiva-twin-q8_0.ggufGGUFQ8_0138.1 MBDownload
dhilipsiva-twin-qwen-q8_0.ggufGGUFQ8_0506.5 MBDownload

Model Details

Model IDdhilipsiva/dhilipsiva-twin-gguf
Authordhilipsiva
Pipeline
Licenseapache-2.0
Base modelHuggingFaceTB/SmolLM2-135M-Instruct,Qwen/Qwen2.5-0.5B-Instruct
Last modified2026-07-07T05:54:37.000Z

Model README

---

license: apache-2.0

language: [en]

base_model:

  • HuggingFaceTB/SmolLM2-135M-Instruct
  • Qwen/Qwen2.5-0.5B-Instruct

tags: [gguf, persona, candle, webassembly, chatml]

---

dhilipsiva-twin — on-device persona models

LoRA fine-tunes that impersonate dhilipsiva — they ARE his

website: served into the visitor's browser and run entirely on-device via

candle compiled to WebAssembly.

| file | base | size | extra trick |

|---|---|---|---|

| dhilipsiva-twin-q8_0.gguf | SmolLM2-135M-Instruct | 145MB | persona |

| dhilipsiva-twin-qwen-q8_0.gguf | Qwen2.5-0.5B-Instruct | 531MB | persona + emits TOOL {"app":…} lines that open the site's MCP apps |

Tokenizers included as tokenizer-smol.json / tokenizer-qwen.json.

ChatML prompting. The system prompt must match the training prompt verbatim

see finetune/generate_dataset.py in the site repo

(SYSTEM for smol, SYSTEM_TOOLS for qwen). Low-temperature decoding recommended

(temp ~0.3): they answer as dhilipsiva on questions about him, and answer general

questions plainly in his voice — fit with a contrast corpus so they no longer recite

his bio for every prompt.

These models will lie, confidently. Fluent ≠ true — that gap is the point:

it's why dhilipsiva builds nibli, a

hallucination firewall that derives answers with proof traces instead of

predicting plausible text. Trained facts are accurate as of 2026-06; everything

else is improv.

Run dhilipsiva/dhilipsiva-twin-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models