transformers gguf mergekit merge llama-cpp gguf-my-repo base_model:win10/Qwen2.5-Coder-12.3b-Instruct base_model:quantized:win10/Qwen2.5-Coder-12.3b-Instruct endpoints_compatible region:us conversational
Small (<1GB)