pytorch llama alignment-handbook generated_from_trainer dataset:HuggingFaceH4/ultrafeedback_binarized dataset:HuggingFaceH4/orca_dpo_pairs dataset:JunxiongWang/llama3-ultrafeedback-armorm arxiv:2408.15237 base_model:JunxiongWang/llama3_mamba_0_5_sft base_model:finetune:JunxiongWang/llama3_mamba_0_5_sft region:us
Small (<1GB)