vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep

Status
Not open for further replies.
Status
Not open for further replies.
Top