transformers safetensors mistral text-generation instruct finetune chatml gpt4 synthetic data distillation dpo rlhf conversational en dataset:mlabonne/chatml_dpo_pairs base_model:teknium/OpenHermes-2.5-Mistral-7B base_model:finetune:teknium/OpenHermes-2.5-Mistral-7B license:apache-2.0 autotrain_compatible text-generation-inference endpoints_compatible region:us
Large (5-20GB)