transformers gguf llama Llama3.2-3B Llama-cpp F16 16-bit Q4 Q5 Q8 8-bit 4-bit text-generation en dataset:yahma/alpaca-cleaned base_model:meta-llama/Llama-3.2-3B base_model:quantized:meta-llama/Llama-3.2-3B license:creativeml-openrail-m endpoints_compatible region:us
Small (<1GB)