GitLab

Signed-off-by: Lu Fang <lufang@fb.com>

[Bugfix] Fix benchmark script bug: inaccurate stats for vllm backend when max_model_len < input_len + output_len (#13691)
Signed-off-by: WangErXiao <863579016@qq.com>

Signed-off-by: Isotr0py <2037008807@qq.com>

Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Patrick Horn <patrick.horn@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

Signed-off-by: John Zheng <john.zheng@hp.com>

Signed-off-by: kerthcet <kerthcet@gmail.com>

Signed-off-by: Lingfan Yu <lingfany@amazon.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: Chen-XiaoBing <chenxb002@whu.edu.cn>

Signed-off-by: <>

Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>

Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>