Uploaded finetuned model

Q: What is amylynn/Riverfish-Rocinante-12B-SFT-GGUF?

--- base_model: amylynn/Riverfish-Rocinante-12B tags: - text-generation-inference - transformers - unsloth - mistral - autoquant - gguf license: apache-2.0 language: - en --- # Uploaded finetuned model - **Developed by:** amylynn - **License:** apache-2.0 - **Finetuned from model :** amylynn/Riverfish-Rocinante-12B This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library. [ ](https://github.com/unslothai/unsloth)

Developed by: amylynn
License: apache-2.0
Finetuned from model : amylynn/Riverfish-Rocinante-12B

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Question 2

What license applies to amylynn/Riverfish-Rocinante-12B-SFT-GGUF?

Accepted Answer

License: apache-2.0. Verify terms on Hugging Face before commercial use.

Question 3

How do I run amylynn/Riverfish-Rocinante-12B-SFT-GGUF locally?

Accepted Answer

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Question 4

How much VRAM or disk space does amylynn/Riverfish-Rocinante-12B-SFT-GGUF need?

Accepted Answer

Runs locally from ~5.67 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

File	Type	Quantization	Size	Link
riverfish-rocinante-12b-sft.q3_k_m.gguf	GGUF	GGUF	5.67 GB	Download
riverfish-rocinante-12b-sft.q4_k_m.gguf	GGUF	GGUF	6.96 GB	Download

amylynn/Riverfish-Rocinante-12B-SFT-GGUF overview

Repository Files & Downloads

Model Details

Model README

Uploaded finetuned model

Run amylynn/Riverfish-Rocinante-12B-SFT-GGUF with guIDE

Model ID	amylynn/Riverfish-Rocinante-12B-SFT-GGUF
Author	amylynn
Pipeline	—
License	apache-2.0
Base model	amylynn/Riverfish-Rocinante-12B
Last modified	2026-07-26T08:52:24.000Z