gguf chat autoquant text-generation en arxiv:2407.10671 base_model:Qwen/Qwen2.5-0.5B base_model:quantized:Qwen/Qwen2.5-0.5B license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)