gguf quantized GGUF quantization imat imatrix static 16bit 8bit 6bit 5bit 4bit 3bit 2bit 1bit text-generation base_model:OpenLLM-Ro/RoLlama3-8b-Instruct base_model:quantized:OpenLLM-Ro/RoLlama3-8b-Instruct region:us conversational
Small (<1GB)