gguf nlp code quantized GGUF quantization imat imatrix static 16bit 8bit 6bit 5bit 4bit 3bit 2bit 1bit text-generation multilingual base_model:microsoft/Phi-3.5-mini-instruct base_model:quantized:microsoft/Phi-3.5-mini-instruct license:mit region:us conversational
Small (<1GB)