peft safetensors trl dpo generated_from_trainer base_model:Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT base_model:adapter:Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT region:us
Small (<1GB)