transformers safetensors mistral text-generation dpo rlaif preference ultrafeedback conversational en dataset:argilla/ultrafeedback-binarized-preferences base_model:alignment-handbook/zephyr-7b-sft-full base_model:finetune:alignment-handbook/zephyr-7b-sft-full license:mit model-index autotrain_compatible text-generation-inference endpoints_compatible region:us
Small (<1GB)