transformers safetensors llama text-generation nvidia llama3.1 w4a16 int4 vllm conversational en base_model:meta-llama/Llama-3.1-70B-Instruct base_model:quantized:meta-llama/Llama-3.1-70B-Instruct license:llama3.1 autotrain_compatible text-generation-inference endpoints_compatible compressed-tensors region:us
Large (5-20GB)