safetensors mistral alignment-handbook trl dpo generated_from_trainer dataset:updated dataset:original base_model:YYYYYYibo/full_vanilla_dpo_iter_1 base_model:finetune:YYYYYYibo/full_vanilla_dpo_iter_1 license:apache-2.0 region:us
Large (5-20GB)