gguf llama-cpp gguf-my-repo base_model:IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml base_model:quantized:IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml license:other endpoints_compatible region:us imatrix
Small (<1GB)