safetensors mistral alignment-handbook trl dpo generated_from_trainer dataset:updated dataset:original base_model:Katayoon/VPO-Pess-Zephyr-7B-iter-1 base_model:finetune:Katayoon/VPO-Pess-Zephyr-7B-iter-1 license:mit region:us
Large (5-20GB)