transformers safetensors qwen2 text-generation trl online-dpo generated_from_trainer conversational dataset:dataset_name base_model:Qwen/Qwen2-0.5B-Instruct base_model:finetune:Qwen/Qwen2-0.5B-Instruct autotrain_compatible text-generation-inference endpoints_compatible region:us
Small (<1GB)