safetensors llama vllm sparsity text-generation conversational en dataset:HuggingFaceH4/ultrachat_200k arxiv:2210.17323 arxiv:2405.03594 base_model:RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4 base_model:quantized:RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4 license:llama3.1 compressed-tensors region:us
Medium (1-5GB)