peft tensorboard safetensors mistral alignment-handbook trl dpo generated_from_trainer dataset:generation/UF dataset:generation/UFfull2 base_model:alignment-handbook/zephyr-7b-sft-full base_model:adapter:alignment-handbook/zephyr-7b-sft-full license:apache-2.0 4-bit bitsandbytes region:us
Small (<1GB)