transformers gguf trl dpo generated_from_trainer en base_model:tongliuphysics/zephyr0-7b-ultra-dpo base_model:quantized:tongliuphysics/zephyr0-7b-ultra-dpo license:mit endpoints_compatible region:us conversational
Small (<1GB)