parameters guide samplers guide model generation role play settings quant selection arm quants iq quants vs q quants optimal model setting gibberish fixes coherence instructing following quality generation chat settings quality settings llamacpp server llamacpp lmstudio sillytavern koboldcpp backyard ollama model generation steering steering model generation fixes text generation webui ggufs exl2 full precision quants imatrix neo imatrix llama llama-3 gemma gemma2 gemma3 llama-2 llama-3.1 llama-3.2 mistral moe mixture of experts mixtral arxiv:2007.14966 arxiv:2306.17806 arxiv:2210.15191 license:apache-2.0 region:us
Small (<1GB)