models — shard inf

334 pages · page 1 of 4

• infatoshi-qwen3.6-35b-a3b-gguf--bf16
• infatoshi-qwen3.6-35b-a3b-gguf--q4_k_m
• infatoshi-qwen3.6-35b-a3b-gguf--q5_k_m
• infatoshi-qwen3.6-35b-a3b-gguf--q8_0
• infatoshi-qwen3.6-35b-a3b-gguf
• inference-snaps-qwen3-coder-30b-a3b-instruct-gguf-q4-k-m-5gb
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq1_m
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq2_m
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq2_s
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq2_xs
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq2_xxs
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq3_m
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq3_s
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq3_xs
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq3_xxs
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--iq4_xs
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--q2_k
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--q3_k_m
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--q4_k_m
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--q4_k_s
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--q5_k_m
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf--q5_k_s
• inferenceillusionist-euryale-1.3-longlora-70b-rope8-32k-imat-gguf
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq1_m
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq2_m
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq2_s
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq2_xs
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq2_xxs
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq3_m
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq3_s
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq3_xs
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq3_xxs
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq4_nl
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--iq4_xs
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--q4_k_m
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--q4_k_s
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--q5_k_m
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--q5_k_s
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--q6_k
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf--q8_0
• inferenceillusionist-fimbulvetr-11b-v2-imat-gguf
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--00002
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq1_m
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq1_s
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq2_m
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq2_s
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq2_xs
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq2_xxs
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq3_m
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq3_s
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq3_xs
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq3_xxs
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--iq4_xs
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--q2_k
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--q3_k_m
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--q3_k_s
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--q4_k_m
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--q4_k_s
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--q5_k_m
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--q5_k_s
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf--q6_k
• inferenceillusionist-l3-70b-euryale-v2.1-imat-gguf
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--00002
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq1_m
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq2_m
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq2_s
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq2_xs
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq2_xxs
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq3_m
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq3_s
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq3_xs
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq3_xxs
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--iq4_xs
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--q2_k
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--q3_k_m
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--q4_k_m
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--q4_k_s
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--q5_k_m
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--q5_k_s
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf--q6_k
• inferenceillusionist-llama-3-70b-instruct-storywriter-imat-gguf
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq1_m
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq2_m
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq2_s
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq2_xs
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq2_xxs
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq3_m
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq3_s
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq3_xs
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq3_xxs
• inferenceillusionist-llama3-42b-v0-imat-gguf--iq4_xs
• inferenceillusionist-llama3-42b-v0-imat-gguf--q2_k
• inferenceillusionist-llama3-42b-v0-imat-gguf--q3_k_m
• inferenceillusionist-llama3-42b-v0-imat-gguf--q4_k_m
• inferenceillusionist-llama3-42b-v0-imat-gguf--q4_k_s
• inferenceillusionist-llama3-42b-v0-imat-gguf--q5_k_m
• inferenceillusionist-llama3-42b-v0-imat-gguf--q5_k_s
• inferenceillusionist-llama3-42b-v0-imat-gguf--q6_k
• inferenceillusionist-llama3-42b-v0-imat-gguf--q8_0
• inferenceillusionist-llama3-42b-v0-imat-gguf

Next