safetensors llama alignment-handbook trl orpo generated_from_trainer dataset:lamm-mit/orpo-dpo-mix-40k dataset:lamm-mit/bioinspired_gpt-4o-mini-silk_dataset_V10-orpo_dataset_V10_messageformat dataset:lamm-mit/bioinspired_gpt-4o-mini-dataset_V1_B-cleaned-orpo_dataset_V10_messageformat region:us
Large (5-20GB)