safetensors qwen2 qwen2.5 gptq int4 vLLM sglang text-generation conversational zho eng fra spa por deu ita rus jpn kor vie tha ara base_model:Qwen/Qwen2.5-72B-Instruct base_model:quantized:Qwen/Qwen2.5-72B-Instruct license:other 4-bit region:us
Large (5-20GB)