transformers gguf finetune dpo Instruct augmentation german en de dataset:argilla/distilabel-math-preference-dpo base_model:fblgit/LUNA-SOLARkrautLM-Instruct base_model:quantized:fblgit/LUNA-SOLARkrautLM-Instruct license:cc-by-nc-4.0 endpoints_compatible region:us imatrix conversational
Small (<1GB)