transformers safetensors generated_from_trainer trl dpo dataset:Anthropic/hh-rlhf arxiv:2305.18290 base_model:XueyingJia/Qwen2-1.5B-SFT-merge base_model:finetune:XueyingJia/Qwen2-1.5B-SFT-merge endpoints_compatible region:us
Small (<1GB)