peft tensorboard safetensors qwen2 alignment-handbook trl dpo generated_from_trainer dataset:HuggingFaceH4/ultrafeedback_binarized base_model:Qwen/Qwen2-1.5B base_model:adapter:Qwen/Qwen2-1.5B 4-bit bitsandbytes region:us
Small (<1GB)