peft tensorboard safetensors mistral alignment-handbook generated_from_trainer trl dpo dataset:HuggingFaceH4/ultrafeedback_binarized base_model:alignment-handbook/zephyr-7b-sft-full base_model:adapter:alignment-handbook/zephyr-7b-sft-full license:apache-2.0 region:us
Small (<1GB)