peft safetensors trl dpo image-text-to-text conversational en dataset:HuggingFaceH4/rlaif-v_formatted base_model:HuggingFaceTB/SmolLM2-1.7B-Instruct base_model:adapter:HuggingFaceTB/SmolLM2-1.7B-Instruct license:apache-2.0 region:us
Small (<1GB)