safetensors mistral trl dpo generated_from_trainer base_model:alignment-handbook/zephyr-7b-sft-full base_model:finetune:alignment-handbook/zephyr-7b-sft-full license:apache-2.0 region:us
Large (5-20GB)