gguf ggml quantized text-generation arxiv:2403.04652 base_model:01-ai/Yi-1.5-6B-Chat base_model:quantized:01-ai/Yi-1.5-6B-Chat license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)