transformers safetensors qwen2 feature-extraction generated_from_trainer trl dpo dataset:openbmb/UltraInteract_pair arxiv:2305.18290 base_model:Qwen/Qwen2.5-0.5B-Instruct base_model:finetune:Qwen/Qwen2.5-0.5B-Instruct text-generation-inference text-embeddings-inference endpoints_compatible region:us
Small (<1GB)