transformers tensorboard safetensors generated_from_trainer trl online-dpo dataset:XueyingJia/hh-rlhf-train arxiv:2402.04792 base_model:Audreygyj/Qwen2.5-0.5B-SFT-merge base_model:finetune:Audreygyj/Qwen2.5-0.5B-SFT-merge endpoints_compatible region:us
Small (<1GB)