transformers gguf dpo rlaif preference ultrafeedback text-generation en dataset:openbmb/UltraFeedback arxiv:2310.01377 base_model:openbmb/UltraCM-13b base_model:quantized:openbmb/UltraCM-13b license:mit region:us
Small (<1GB)