gguf mistral quantized 2-bit 3-bit 4-bit 5-bit 6-bit 8-bit GGUF text-generation base_model:rhyang2021/uncertain_llama3_8b base_model:quantized:rhyang2021/uncertain_llama3_8b region:us conversational
Small (<1GB)