Abstract: This letter introduces LLMServingSim2.0, a system simulator designed for exploring heterogeneous hardware in large-scale LLM serving systems. LLMServingSim2.0 addresses two key limitations ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results