transformers safetensors qwen2 text-generation generated_from_trainer trl dpo conversational dataset:trl-lib/ultrafeedback_binarized arxiv:2305.18290 base_model:JayHyeon/Qwen2.5-0.5B-SFT-2e-5-5ep base_model:finetune:JayHyeon/Qwen2.5-0.5B-SFT-2e-5-5ep autotrain_compatible text-generation-inference endpoints_compatible region:us
Small (<1GB)