transformers gguf Qwen2.5 Coder 7B Instruct F16 Q4 Q5 Q8 16-bit Llama-cpp text-generation en base_model:Qwen/Qwen2.5-Coder-7B-Instruct base_model:quantized:Qwen/Qwen2.5-Coder-7B-Instruct license:creativeml-openrail-m endpoints_compatible region:us conversational
Small (<1GB)