safetensors mistral alignment-handbook trl dpo generated_from_trainer dataset:updated dataset:original base_model:Katayoon/VPO-Zephyr-7B-0.05-iter-2 base_model:finetune:Katayoon/VPO-Zephyr-7B-0.05-iter-2 license:mit region:us
Large (5-20GB)