transformers gguf mistral instruct finetune chatml gpt4 synthetic data distillation dpo rlhf laser en dataset:mlabonne/chatml_dpo_pairs base_model:mlabonne/NeuralHermes-2.5-Mistral-7B-laser base_model:quantized:mlabonne/NeuralHermes-2.5-Mistral-7B-laser license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)