safetensors llama vllm sparsity quantization int4 text-generation en dataset:theblackcat102/evol-codealpaca-v1 arxiv:2107.03374 base_model:RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4 base_model:quantized:RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4 license:llama3.1 compressed-tensors region:us
Large (5-20GB)