transformers tensorboard safetensors generated_from_trainer trl dpo arxiv:2305.18290 base_model:Qwen/Qwen2.5-3B-Instruct base_model:finetune:Qwen/Qwen2.5-3B-Instruct endpoints_compatible region:us
Small (<1GB)