transformers gguf orpo qlora trl en dataset:alvarobartt/dpo-mix-7k-simplified dataset:argilla/dpo-mix-7k base_model:alvarobartt/Mistral-7B-v0.1-ORPO base_model:quantized:alvarobartt/Mistral-7B-v0.1-ORPO license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)