gguf llama-cpp gguf-my-repo base_model:botox100/Meta-Llama-3-8B-instruct_prune_lora base_model:quantized:botox100/Meta-Llama-3-8B-instruct_prune_lora endpoints_compatible region:us conversational
Small (<1GB)