transformers gguf mergekit merge llama-cpp gguf-my-repo base_model:ehristoforu/qwen2.5-test-32b-it base_model:quantized:ehristoforu/qwen2.5-test-32b-it endpoints_compatible region:us conversational
Small (<1GB)