safetensors llama vllm sparsity text-generation conversational en dataset:HuggingFaceH4/ultrachat_200k arxiv:2405.03594 base_model:RedHatAI/Sparse-Llama-3.1-8B-2of4 base_model:finetune:RedHatAI/Sparse-Llama-3.1-8B-2of4 license:llama3.1 region:us
Large (5-20GB)