transformers orpo qlora trl text-generation en dataset:alvarobartt/dpo-mix-7k-simplified dataset:argilla/dpo-mix-7k base_model:mistralai/Mistral-7B-v0.1 base_model:finetune:mistralai/Mistral-7B-v0.1 license:apache-2.0 region:us
Small (<1GB)