transformers safetensors llama text-generation alignment-handbook trl dpo generated_from_trainer conversational dataset:Magpie-Align/MagpieLM-SFT-Data-v0.1 dataset:Magpie-Align/MagpieLM-DPO-Data-v0.1 arxiv:2406.08464 arxiv:2411.07133 base_model:Magpie-Align/MagpieLM-8B-SFT-v0.1 base_model:finetune:Magpie-Align/MagpieLM-8B-SFT-v0.1 license:llama3.1 autotrain_compatible text-generation-inference endpoints_compatible region:us
Large (5-20GB)