gguf text-generation-inference ggml quantized q2_k q3_k_m q4_k_m q5_k_m q6_k q8_0 text-generation en dataset:tatsu-lab/alpaca base_model:p208p2002/bloomz-Alpaca-560M base_model:quantized:p208p2002/bloomz-Alpaca-560M region:us
Small (<1GB)