transformers safetensors llama text-generation deepseek int8 vllm llmcompressor conversational arxiv:2210.17323 base_model:deepseek-ai/DeepSeek-R1-Distill-Llama-8B base_model:quantized:deepseek-ai/DeepSeek-R1-Distill-Llama-8B license:mit autotrain_compatible text-generation-inference endpoints_compatible 8-bit compressed-tensors region:us
Large (5-20GB)