transformers tensorboard safetensors mistral text-generation orpo qlora trl conversational en dataset:alvarobartt/dpo-mix-7k-simplified dataset:argilla/dpo-mix-7k arxiv:2403.07691 base_model:mistralai/Mistral-7B-v0.1 base_model:finetune:mistralai/Mistral-7B-v0.1 license:apache-2.0 autotrain_compatible text-generation-inference region:us
Large (5-20GB)