transformers safetensors mistral text-generation instruct finetune chatml gpt4 synthetic data distillation dpo rlhf conversational en dataset:mlabonne/chatml_dpo_pairs base_model:mlabonne/NeuralHermes-2.5-Mistral-7B base_model:quantized:mlabonne/NeuralHermes-2.5-Mistral-7B license:apache-2.0 autotrain_compatible text-generation-inference 4-bit gptq region:us
Medium (1-5GB)