transformers gguf mistral quantized 2-bit 3-bit 4-bit 5-bit 6-bit 8-bit GGUF pytorch safetensors llama text-generation llama-2 code arxiv:2308.12950 license:llama2 autotrain_compatible endpoints_compatible has_space text-generation-inference region:us base_model:codellama/CodeLlama-34b-Instruct-hf base_model:quantized:codellama/CodeLlama-34b-Instruct-hf license:apache-2.0
Small (<1GB)