mistral instruct finetune chatml gpt4 synthetic data distillation dpo rlhf text-generation en dataset:mlabonne/chatml_dpo_pairs base_model:teknium/OpenHermes-2.5-Mistral-7B base_model:finetune:teknium/OpenHermes-2.5-Mistral-7B license:apache-2.0 region:us
Small (<1GB)