transformers gguf text-generation-inference LwQ safetensors Llama3.1 en base_model:prithivMLmods/LwQ-10B-Instruct base_model:quantized:prithivMLmods/LwQ-10B-Instruct license:llama3.1 endpoints_compatible region:us imatrix conversational
Small (<1GB)