transformers gguf llama text-generation-inference unsloth text-generation en base_model:unsloth/Meta-Llama-3.1-8B-bnb-4bit base_model:quantized:unsloth/Meta-Llama-3.1-8B-bnb-4bit license:apache-2.0 endpoints_compatible region:us
Small (<1GB)