GitLab

Signed-off-by: zibai <zibai.gj@alibaba-inc.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Signed-off-by: Alexander Matveev <alexm@neuralmagic.com>

Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

Signed-off-by: rbbang <anjaehyun87@gmail.com>

Signed-off-by: Mozhou <spli161006@gmail.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Signed-off-by: daitran2k1 <tranquangdai7a@gmail.com>

Signed-off-by: Russell Bryant <rbryant@redhat.com>

Co-authored-by: Isotr0py <2037008807@qq.com>

Update benchmark_serving.py to read and write json-datasets, results in UTF8, for better compatibility with Windows (#8997)

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>

Co-authored-by: Michael Goin <michael@neuralmagic.com>

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

[Bugfix] Benchmark serving script used global parameter 'args' in function 'sample_random_requests' (#6428)

Co-authored-by: simon-mo <simon.mo@hey.com>

Co-authored-by: Roger Wang <ywang@roblox.com>

Co-authored-by: Roger Wang <ywang@roblox.com>

[CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with `perf-benchmarks` label (#5073)
Co-authored-by: simon-mo <simon.mo@hey.com>

Co-authored-by: Roger Wang <ywang@roblox.com>