gguf vllm sparsity text-generation arxiv:2301.00774 arxiv:2310.06927 base_model:meta-llama/Llama-3.1-8B base_model:quantized:meta-llama/Llama-3.1-8B license:llama3.1 endpoints_compatible region:us
Small (<1GB)