peft tensorboard safetensors mistral alignment-handbook generated_from_trainer trl dpo dataset:HuggingFaceH4/ultrafeedback_binarized base_model:DUAL-GPO/zephyr-7b-gpo-final-i0 base_model:adapter:DUAL-GPO/zephyr-7b-gpo-final-i0 license:mit region:us
Small (<1GB)