transformers gguf trl orpo generated_from_trainer en base_model:sert121/orpo_pythia2_hh_filtered base_model:quantized:sert121/orpo_pythia2_hh_filtered license:apache-2.0 endpoints_compatible region:us
Small (<1GB)