gguf quantized 2-bit 3-bit 4-bit 5-bit 6-bit 8-bit GGUF text-generation en de fr it pt hi es th arxiv:2204.05149 base_model:meta-llama/Llama-3.1-8B-Instruct base_model:quantized:meta-llama/Llama-3.1-8B-Instruct license:llama3.1 region:us imatrix conversational
Small (<1GB)