transformers safetensors mistral text-generation instruct finetune chatml gpt4 synthetic data distillation dpo rlhf laser quantized 4-bit AWQ autotrain_compatible endpoints_compatible conversational en dataset:mlabonne/chatml_dpo_pairs arxiv:2312.13558 base_model:mlabonne/NeuralHermes-2.5-Mistral-7B-laser base_model:quantized:mlabonne/NeuralHermes-2.5-Mistral-7B-laser license:apache-2.0 model-index text-generation-inference awq region:us
Medium (1-5GB)