gguf chat text-generation zho eng fra spa por deu ita rus jpn kor vie tha ara arxiv:2407.10671 base_model:Qwen/Qwen2.5-3B base_model:quantized:Qwen/Qwen2.5-3B license:other endpoints_compatible region:us conversational
Small (<1GB)