transformers gguf nm-vllm sparse en base_model:RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4 base_model:quantized:RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4 endpoints_compatible region:us imatrix conversational
Small (<1GB)