transformers gguf alignment-handbook trl dpo generated_from_trainer en dataset:pbevan11/multilingual-constitutional-preference-pairs dataset:pbevan11/ultrafeedback_binarized_multilingual base_model:pbevan11/Mistral-Nemo-MCAI-SFT-DPO base_model:quantized:pbevan11/Mistral-Nemo-MCAI-SFT-DPO license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)