transformers tensorboard safetensors mistral text-generation alignment-handbook trl dpo generated_from_trainer conversational dataset:pbevan11/multilingual-constitutional-preference-pairs dataset:pbevan11/ultrafeedback_binarized_multilingual base_model:pbevan11/Mistral-Nemo-MCAI-SFT base_model:finetune:pbevan11/Mistral-Nemo-MCAI-SFT license:apache-2.0 autotrain_compatible text-generation-inference endpoints_compatible region:us
Large (5-20GB)