peft safetensors mistral alignment-handbook trl dpo generated_from_trainer dataset:nthakur/multilingual-ultrafeedback-binarized-dpo-v0.1 dataset:nthakur/multilingual-distilabel-intel-orca-dpo-pairs-v0.1 dataset:nthakur/multilingual-truthy-dpo-pairs-v0.1 dataset:nthakur/GSM8KInstruct-Parallel-instruct-dpo-v0.1 base_model:mistralai/Mistral-7B-Instruct-v0.2 base_model:adapter:mistralai/Mistral-7B-Instruct-v0.2 license:apache-2.0 region:us
Small (<1GB)