transformers gguf alignment-handbook trl orpo generated_from_trainer en dataset:alvarobartt/airoboros2.2-pref-10k base_model:alvarobartt/mistral-7b-orpo-airoboros-pref-10k base_model:quantized:alvarobartt/mistral-7b-orpo-airoboros-pref-10k license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)