gguf llama-cpp gguf-my-repo base_model:avemio/German-RAG-PHI-3.5-MINI-4B-SFT-HESSIAN-AI base_model:quantized:avemio/German-RAG-PHI-3.5-MINI-4B-SFT-HESSIAN-AI endpoints_compatible region:us conversational
Small (<1GB)