transformers gguf generated_from_trainer trl dpo en base_model:AmberYifan/Qwen2.5-7B-sft-SPIN-gpt4o-rm base_model:quantized:AmberYifan/Qwen2.5-7B-sft-SPIN-gpt4o-rm endpoints_compatible region:us conversational
Small (<1GB)