peft safetensors mistral alignment-handbook trl dpo generated_from_trainer dataset:HuggingFaceH4/ultrafeedback_binarized base_model:HuggingFaceH4/mistral-7b-sft-beta base_model:adapter:HuggingFaceH4/mistral-7b-sft-beta license:mit region:us
Small (<1GB)