gguf quantized GGUF quantization static 16bit 8bit 6bit 5bit 4bit 3bit 2bit text-generation base_model:nvidia/Llama-3.1-Minitron-4B-Width-Base base_model:quantized:nvidia/Llama-3.1-Minitron-4B-Width-Base license:other region:us
Small (<1GB)