N
Hacker Next
new
show
ask
jobs
submit
login
vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep
blog.vllm.ai
147 points by
robertnishihara
3 days ago
|
54 comments
add comment