transformers qwen qwen2.5 finetune dpo orpo qwen2 chat conversational instruct storywriting roleplay novelwriting text-generation en dataset:jondurbin/gutenberg-dpo-v0.1 dataset:Qwen/Qwen2.5-14B-Instruct dataset:HuggingFaceH4/ultrafeedback_binarized arxiv:2403.19522 base_model:v000000/Qwen2.5-Lumen-14B base_model:finetune:v000000/Qwen2.5-Lumen-14B license:apache-2.0 model-index endpoints_compatible region:us
Small (<1GB)