transformers gguf alignment-handbook trl dpo generated_from_trainer en dataset:HuggingFaceH4/hh-rlhf-h4 base_model:NicholasCorrado/zephyr-7b-hh-dpo base_model:quantized:NicholasCorrado/zephyr-7b-hh-dpo license:apache-2.0 endpoints_compatible region:us imatrix conversational
Small (<1GB)