trl safetensors DPO WeniGPT en base_model:Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT base_model:finetune:Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT license:mit region:us
Small (<1GB)