transformers gguf TensorBlock GGUF en base_model:DeepAuto-AI/ldm_soup_Llama-3.1-8B-Inst base_model:quantized:DeepAuto-AI/ldm_soup_Llama-3.1-8B-Inst license:apache-2.0 model-index endpoints_compatible region:us conversational
Small (<1GB)