gguf text-generation-inference TensorBlock GGUF base_model:arnavgrg/mistral-7b-nf4-fp16-upscaled base_model:quantized:arnavgrg/mistral-7b-nf4-fp16-upscaled license:apache-2.0 endpoints_compatible region:us
Small (<1GB)