safetensors llama alignment-handbook trl dpo generated_from_trainer en dataset:Magpie-Align/Llama-3.1-70B-PO-100K-armorm arxiv:2406.08464 arxiv:2406.12845 base_model:Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.2 base_model:finetune:Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.2 license:llama3.1 region:us
Large (5-20GB)