transformers gguf chat autoquant text-generation en arxiv:2409.12122 base_model:Qwen/Qwen2.5-Math-7B base_model:quantized:Qwen/Qwen2.5-Math-7B license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)