transformers safetensors llama text-generation int8 vllm conversational en de fr it pt hi es th arxiv:2210.17323 base_model:meta-llama/Llama-3.1-8B-Instruct base_model:quantized:meta-llama/Llama-3.1-8B-Instruct license:llama3.1 autotrain_compatible text-generation-inference endpoints_compatible 8-bit compressed-tensors region:us
Large (5-20GB)