gguf ggml quantized q2_k q3_k_m q4_k_m q5_k_m q6_k q8_0 text-generation dataset:euclaise/MiniCoT dataset:euclaise/SciCoT dataset:euclaise/symtune_mini dataset:euclaise/mathoverflow-accepted dataset:euirim/goodwiki base_model:euclaise/Ferret-3B base_model:quantized:euclaise/Ferret-3B region:us conversational
Small (<1GB)