transformers safetensors generated_from_trainer trl dpo arxiv:2305.18290 base_model:teknium/OpenHermes-2.5-Mistral-7B base_model:finetune:teknium/OpenHermes-2.5-Mistral-7B endpoints_compatible region:us
Small (<1GB)