gguf quantized GGUF quantization imat imatrix static 16bit 8bit 6bit 5bit 4bit 3bit 2bit 1bit text-generation base_model:facebook/llm-compiler-13b base_model:quantized:facebook/llm-compiler-13b license:other region:us
Small (<1GB)