transformers safetensors mixtral text-generation Mixtral instruct finetune chatml DPO RLHF gpt4 synthetic data distillation conversational en base_model:NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT base_model:quantized:NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT license:apache-2.0 autotrain_compatible text-generation-inference 4-bit gptq region:us
Large (5-20GB)