transformers gguf alignment-handbook trl dpo generated_from_trainer en dataset:Magpie-Align/Magpie-Llama-3.1-Pro-DPO-100K-v0.1 base_model:Magpie-Align/Llama-3.1-Minitron-4B-Magpie-SFT-650K-MT-Magpo-3.1-Pro-05 base_model:quantized:Magpie-Align/Llama-3.1-Minitron-4B-Magpie-SFT-650K-MT-Magpo-3.1-Pro-05 license:other endpoints_compatible region:us conversational
Small (<1GB)