transformers gguf alignment-handbook trl orpo generated_from_trainer en dataset:argilla/Capybara-Preferences base_model:orpo-explorers/mistral-7b-orpo-v5.0 base_model:quantized:orpo-explorers/mistral-7b-orpo-v5.0 license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)