gguf ggml quantized q2_k q3_k_m q4_k_m q5_k_m q6_k q8_0 text-generation base_model:jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco base_model:quantized:jncraton/TinyLlama-1.1B-intermediate-step-955k-token-2T-guanaco region:us
Small (<1GB)