Hugging Face's logo

bobber
/
routangseng-qwen35-0.8b-abliterated-gguf

GGUF
Chinese
English
llama.cpp
llama-cpp
qwen3.5
chinese
uncensored
conversational
Model card Files
xet
 Community

Routangseng Qwen3.5-0.8B Abliterated GGUF

GGUF export of the stable sft-qwen35-0.8b-abliterated-run1 checkpoint.

Files

  • sft-qwen35-0.8b-abliterated-f16.gguf
  • sft-qwen35-0.8b-abliterated-q4_k_m.gguf
  • sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00001-of-00003.gguf
  • sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00002-of-00003.gguf
  • sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00003-of-00003.gguf

Notes

  • Base model: huihui-ai/Huihui-Qwen3.5-0.8B-abliterated
  • Intended for the bobber/routangseng-chat Hugging Face Space.
  • Split GGUF chunks were added for browser friendliness with wllama; point the loader at the first -00001-of-00003.gguf shard.
Downloads last month
175
GGUF
Model size
0.8B params
Architecture
qwen35
Hardware compatibility
Log In to add your hardware

4-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for bobber/routangseng-qwen35-0.8b-abliterated-gguf

Base model

Qwen/Qwen3.5-0.8B-Base
Finetuned
Qwen/Qwen3.5-0.8B
Finetuned
huihui-ai/Huihui-Qwen3.5-0.8B-abliterated
Quantized
(5)
this model