CHONG YOE YAT

CHONGYOEYAT's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in FunAudioLLM/Fun-CosyVoice3-0.5B-2512 18 days ago

sharing my VLLM inference code

#12 opened 18 days ago by

CHONGYOEYAT

New activity in tencent/WeDLM-8B-Instruct 29 days ago

hi i write a openai compatible api server for wedlm 8b

❤️ 2

#7 opened 29 days ago by

CHONGYOEYAT

New activity in mistralai/Devstral-Small-2-24B-Instruct-2512 about 2 months ago

Tool call parsing error

3

#15 opened about 2 months ago by

wasiuddina

New activity in moonshotai/Kimi-K2-Thinking about 2 months ago

Kimi-K2-Thinking vLLM self host tool call fail

1

#40 opened about 2 months ago by

CHONGYOEYAT

New activity in tencent/HunyuanOCR about 2 months ago

VLLM when have more then 3 concurrent connection to do OCR it will fail

1

#20 opened about 2 months ago by

CHONGYOEYAT

New activity in Qwen/Qwen3-VL-235B-A22B-Instruct-FP8 about 2 months ago

Observed same memory leak issue caused OOM when multiple completion requests with difference video or picture per prompt

#6 opened about 2 months ago by

CHONGYOEYAT

New activity in rednote-hilab/dots.ocr 5 months ago

没打算提交PR 给 vllm 和 transformers 吗？

👍 1

1

#28 opened 5 months ago by

CHONGYOEYAT

New activity in Qwen/Qwen2-Audio-7B-Instruct about 1 year ago

When will be able to provide a 4, 8bit quantized version？

1

#5 opened over 1 year ago by

fukai