transformers gguf alignment-handbook trl dpo generated_from_trainer en dataset:HuggingFaceH4/ultrafeedback_binarized base_model:nnheui/pythia-1.4b-dpo-full base_model:quantized:nnheui/pythia-1.4b-dpo-full license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)