peft tensorboard safetensors trl dpo generated_from_trainer base_model:rasyosef/phi-2-sft-openhermes-128k-v2-merged base_model:adapter:rasyosef/phi-2-sft-openhermes-128k-v2-merged region:us
Small (<1GB)