transformers safetensors gguf text-generation-inference unsloth qwen2 trl en base_model:unsloth/Qwen2.5-3B-Instruct-bnb-4bit base_model:quantized:unsloth/Qwen2.5-3B-Instruct-bnb-4bit license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)