gguf llama-cpp gguf-my-repo base_model:DrNicefellow/Rude-Assistant-Qwen2-7b-SFT-then-DPOed-Polite base_model:quantized:DrNicefellow/Rude-Assistant-Qwen2-7b-SFT-then-DPOed-Polite endpoints_compatible region:us conversational
Small (<1GB)