gguf distilabel dpo rlaif rlhf en dataset:argilla/distilabel-intel-orca-dpo-pairs base_model:argilla/distilabeled-OpenHermes-2.5-Mistral-7B base_model:quantized:argilla/distilabeled-OpenHermes-2.5-Mistral-7B license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)