ubergarm

/

GLM-4.7-GGUF

like 18

I held off on both smol-IQ2_KS and IQ2_KS sizes until doing a few more perplexity tests to dial in a good recipe, but yes these two sizes are the sweet spot for many home users including myself!

Okay, the smol-IQ2_KS is looking pretty good! I've tested on the remote rig, but gotta download it myself for local use haha

Also for both ik and mainline fans, check out good small one (slightly larger) too: https://huggingface.co/AesSedai/GLM-4.7-GGUF/tree/main/GLM-4.7-IQ2_M it is mostly iq3_xxs and iq2_xxs for routed exps which are some of the last quant types ik did on mainline.