peft tensorboard safetensors llama alignment-handbook trl dpo generated_from_trainer dataset:HuggingFaceH4/ultrafeedback_binarized base_model:HuggingFaceTB/SmolLM2-1.7B-sft-only base_model:adapter:HuggingFaceTB/SmolLM2-1.7B-sft-only 4-bit bitsandbytes region:us
Small (<1GB)