peft safetensors mistral alignment-handbook generated_from_trainer trl dpo dataset:snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset base_model:mistralai/Mistral-7B-Instruct-v0.2 base_model:adapter:mistralai/Mistral-7B-Instruct-v0.2 license:apache-2.0 region:us
Small (<1GB)