gguf quantized GGUF imatrix quantization imat static 16bit 8bit 6bit 5bit 4bit 3bit 2bit 1bit text-generation base_model:bosonai/Higgs-Llama-3-70B base_model:quantized:bosonai/Higgs-Llama-3-70B license:other region:us conversational
Small (<1GB)