peft safetensors mistral alignment-handbook generated_from_trainer trl dpo dataset:updated dataset:original base_model:mistralai/Mistral-7B-v0.1 base_model:adapter:mistralai/Mistral-7B-v0.1 license:apache-2.0 4-bit bitsandbytes region:us
Small (<1GB)