peft safetensors trl dpo DPO WeniGPT generated_from_trainer base_model:Weni/WeniGPT-Agents-Mistral-1.0.0-SFT-merged base_model:adapter:Weni/WeniGPT-Agents-Mistral-1.0.0-SFT-merged region:us
Small (<1GB)