gguf alignment-handbook trl dpo generated_from_trainer TensorBlock GGUF dataset:HuggingFaceH4/ultrafeedback_binarized base_model:Katayoon/DPO-ONLY-Zephyr-7B base_model:quantized:Katayoon/DPO-ONLY-Zephyr-7B license:mit endpoints_compatible region:us conversational
Small (<1GB)