transformers gguf alignment-handbook trl dpo generated_from_trainer en dataset:pbevan11/multilingual-constitutional-preference-pairs-revision-only dataset:pbevan11/ultrafeedback_binarized_multilingual base_model:pbevan11/Mistral-Nemo-MCAI-SFT-DPO-revision-only base_model:quantized:pbevan11/Mistral-Nemo-MCAI-SFT-DPO-revision-only license:apache-2.0 endpoints_compatible region:us imatrix conversational
Small (<1GB)