transformers safetensors generated_from_trainer trl online-dpo dataset:trl-lib/tldr arxiv:2402.04792 base_model:trl-lib/pythia-1b-deduped-tldr-sft base_model:finetune:trl-lib/pythia-1b-deduped-tldr-sft endpoints_compatible region:us
Small (<1GB)