gguf kto dpo human feedback rlhf preferences alignment HALO halos rl rlaif en dataset:snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset arxiv:2402.01306 base_model:ContextualAI/Contextual_KTO_Mistral_PairRM base_model:quantized:ContextualAI/Contextual_KTO_Mistral_PairRM license:apache-2.0 region:us conversational
Small (<1GB)