peft tensorboard safetensors phi alignment-handbook generated_from_trainer trl dpo custom_code dataset:HuggingFaceH4/ultrafeedback_binarized base_model:DUAL-GPO/phi-2-ipo-chatml-lora-20k-40k-i1-merged base_model:adapter:DUAL-GPO/phi-2-ipo-chatml-lora-20k-40k-i1-merged region:us
Small (<1GB)