gguf TensorBlock GGUF base_model:CHIH-HUNG/llama-2-13b-FINETUNE5_4w-r8-q_k_v_o_gate_up_down base_model:quantized:CHIH-HUNG/llama-2-13b-FINETUNE5_4w-r8-q_k_v_o_gate_up_down endpoints_compatible region:us
Small (<1GB)