transformers gguf mistral finetune dpo Instruct augmentation german mixtral moe en de fr it es dataset:argilla/distilabel-math-preference-dpo base_model:VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct base_model:quantized:VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct license:apache-2.0 endpoints_compatible region:us imatrix conversational
Small (<1GB)