pytorch qwen2 awq vllm 4bit text-generation conversational en dataset:PowerInfer/QWQ-LONGCOT-500K dataset:PowerInfer/LONGCOT-Refine-500K base_model:PowerInfer/SmallThinker-3B-Preview base_model:quantized:PowerInfer/SmallThinker-3B-Preview 4-bit region:us
Small (<1GB)