transformers gguf generated_from_trainer trl xpo en dataset:trl-lib/ultrafeedback-prompt base_model:MYC081/Qwen2.5-3B-WPO-bf16-1 base_model:quantized:MYC081/Qwen2.5-3B-WPO-bf16-1 endpoints_compatible region:us conversational
Small (<1GB)