transformers gguf roleplay conversational llama-cpp gguf-my-repo base_model:allura-org/Q3-30b-A3b-Pentiment base_model:quantized:allura-org/Q3-30b-A3b-Pentiment endpoints_compatible region:us
Small (<1GB)