safetensors qwen2 int8 vllm llm-compressor text-generation conversational en arxiv:2210.17323 base_model:Qwen/Qwen2.5-7B base_model:quantized:Qwen/Qwen2.5-7B license:apache-2.0 compressed-tensors region:us
Medium (1-5GB)