transformers tensorboard safetensors generated_from_trainer trl dpo arxiv:2305.18290 base_model:meta-llama/Llama-3.2-1B base_model:finetune:meta-llama/Llama-3.2-1B endpoints_compatible region:us
Small (<1GB)