gguf vllm sparsity TensorBlock GGUF text-generation base_model:RedHatAI/Sparse-Llama-3.1-8B-2of4 base_model:quantized:RedHatAI/Sparse-Llama-3.1-8B-2of4 license:llama3.1 endpoints_compatible region:us
Small (<1GB)