trl orpo generated_from_trainer exl2 dataset:argilla/distilabel-capybara-dpo-7k-binarized base_model:mistral-community/Mixtral-8x22B-v0.1 base_model:finetune:mistral-community/Mixtral-8x22B-v0.1 license:apache-2.0 region:us
Small (<1GB)