transformers gguf alignment-handbook generated_from_trainer trl dpo TensorBlock GGUF dataset:self-generate/qw2_sppo_hard_new_cn_mining_oj_iter1-binarized license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)