transformers gguf mistral instruct finetune chatml gpt4 synthetic data distillation dpo rlhf en dataset:unalignment/toxic-dpo-v0.1 base_model:joey00072/ToxicHermes-2.5-Mistral-7B base_model:quantized:joey00072/ToxicHermes-2.5-Mistral-7B license:apache-2.0 endpoints_compatible region:us imatrix conversational
Small (<1GB)