transformers gguf alignment-handbook trl dpo generated_from_trainer en dataset:Dahoas/full-hh-rlhf base_model:AmberYifan/Mistral-7B-Instruct-v0.2-DPO base_model:quantized:AmberYifan/Mistral-7B-Instruct-v0.2-DPO license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)