Cant run Q8 on Ollama

#5
by randodando - opened

Cant run Q8_0 on Ollama.
"500 Internal Server Error: unable to load model: C:\Users\User.ollama\models\blobs\sha256-39579e349e291e70a6391eebfb8a93046d5798e018df0a029cc6408c35ecbb80"
Win 11
RTX 4070 Ti 16G.

Can run Q4_K_M.

Sign up or log in to comment