transformers gguf trl sft TensorBlock GGUF base_model:SongTonyLi/Llama-3.2-3B-Instruct-SFT-D_chosen-pref-mix base_model:quantized:SongTonyLi/Llama-3.2-3B-Instruct-SFT-D_chosen-pref-mix endpoints_compatible region:us conversational
Small (<1GB)