peft tensorboard safetensors trl dpo generated_from_trainer dataset:unalignment/toxic-dpo-v0.1 base_model:unsloth/zephyr-sft-bnb-4bit base_model:adapter:unsloth/zephyr-sft-bnb-4bit region:us
Small (<1GB)