gguf llama-cpp gguf-my-repo base_model:princeton-nlp/Sheared-LLaMA-1.3B-ShareGPT base_model:quantized:princeton-nlp/Sheared-LLaMA-1.3B-ShareGPT license:apache-2.0 endpoints_compatible region:us imatrix
Small (<1GB)