transformers gguf alignment-handbook trl dpo generated_from_trainer en dataset:HuggingFaceH4/ultrafeedback_binarized base_model:Minbyul/llama2-7b-dpo-full-sft-wo-kqa_silver_wogold base_model:quantized:Minbyul/llama2-7b-dpo-full-sft-wo-kqa_silver_wogold endpoints_compatible region:us
Small (<1GB)