transformers gguf finetune dpo Instruct augmentation german en de dataset:argilla/distilabel-math-preference-dpo base_model:VAGOsolutions/SauerkrautLM-SOLAR-Instruct base_model:quantized:VAGOsolutions/SauerkrautLM-SOLAR-Instruct license:cc-by-nc-4.0 endpoints_compatible region:us conversational
Small (<1GB)