gguf llama-cpp gguf-my-repo text-generation-inference ro base_model:OpenLLM-Ro/RoLlama3-8b-Instruct base_model:quantized:OpenLLM-Ro/RoLlama3-8b-Instruct license:cc-by-nc-4.0 endpoints_compatible region:us conversational
Small (<1GB)