transformers safetensors generated_from_trainer trl online-dpo dataset:XueyingJia/hh-rlhf-train-filtered arxiv:2402.04792 base_model:Qwen/Qwen2.5-0.5B-Instruct base_model:finetune:Qwen/Qwen2.5-0.5B-Instruct endpoints_compatible region:us
Small (<1GB)