transformers gguf generated_from_trainer trl online-dpo en base_model:trl-lib/Qwen2-0.5B-OnlineDPO base_model:quantized:trl-lib/Qwen2-0.5B-OnlineDPO endpoints_compatible region:us conversational
Small (<1GB)