transformers safetensors generated_from_trainer trl sft dataset:Anthropic/hh-rlhf base_model:XueyingJia/pythia-160m-stage1-dpo-SG-merge base_model:finetune:XueyingJia/pythia-160m-stage1-dpo-SG-merge endpoints_compatible region:us
Small (<1GB)