NHacker Next
  • new
  • show
  • ask
  • jobs
  • submit
login
vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-epblog.vllm.ai
147 points by robertnishihara 3 days ago | 54 comments