Commits · 71e4b81750b87a8b213d60627bee46ae780741a9 · OpenDAS / vllm_cscc

29 Jul, 2025 1 commit
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
23 Jul, 2025 1 commit

[BugFix] Update python to python3 calls for image; fix prefix & input calculations. (#21391) · 4f76a05f

ericehanley authored Jul 22, 2025


Signed-off-by: Eric Hanley <ericehanley@google.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

4f76a05f

22 Jul, 2025 2 commits
- [benchmark] Port benchmark request sent optimization to benchmark_serving (#21209) · 10904e6d
  Jialin Ouyang authored Jul 22, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  10904e6d
- Revert "[Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) (#21334) · e7b20426
  Ming Yang authored Jul 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  e7b20426
21 Jul, 2025 1 commit
- [perf] Speed up align sum kernels (#21079) · 0ec82edd
  Himanshu Jaju authored Jul 21, 2025
```
Signed-off-by: Himanshu Jaju <hj@mistral.ai>
```
  0ec82edd
19 Jul, 2025 2 commits

GLM-4 Update (#20736) · 10eb24cc

Yuxuan Zhang authored Jul 20, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>

10eb24cc

[Misc][Tools][Benchmark] Add readme file for auto_tune script (#20779) · 3a2cb264
Chenyaaang authored Jul 19, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
3a2cb264

18 Jul, 2025 1 commit
- [Core] Avoid KVCacheBlock.__eq__ invocations in FreeKVCacheBlockQueue (#21005) · 0f199f19
  JialinOuyang-Meta authored Jul 18, 2025
```
Signed-off-by: Jialin Ouyang <jialino@meta.com>
```
  0f199f19
17 Jul, 2025 3 commits
- [Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) · 9fb2d220
  ElizaWszola authored Jul 17, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  9fb2d220
- add fa-pa benchmark · 1a9a61d7
  zhuwenwen authored Jul 17, 2025
  
  1a9a61d7
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
11 Jul, 2025 3 commits
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  31d5c179
- [Feature] Integrate SM100 DeepGEMM support (#20087) · e2de455c
  Wentao Ye authored Jul 10, 2025
  
  e2de455c
10 Jul, 2025 1 commit

[Bugfix][Benchmark] Make sure the output length > 0 when testing prefill workload. (#20786) · 5b6fe23d

Kuntai Du authored Jul 10, 2025


Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

5b6fe23d

09 Jul, 2025 2 commits
- [Bench] Add NVFP4 GEMM benchmark script (#20578) · 0bbac1c1
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0bbac1c1
- [Benchmark] Parameterization of streaming loading of multimodal datasets (#20528) · 9ff2af6d
  Li Wang authored Jul 09, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  9ff2af6d
06 Jul, 2025 1 commit

[Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b

Brayden Zhong authored Jul 06, 2025


[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>

cede942b

04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
02 Jul, 2025 1 commit

[Kernels] MoE refactor (#19636) · c1909e7e

bnellnm authored Jul 02, 2025


Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>

c1909e7e

01 Jul, 2025 2 commits
- [Misc] remove redundant char (#20287) · b1c1fe35
  Kebe authored Jul 01, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  b1c1fe35
- Enable ZP Support for Machete (#20268) · 9909726d
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  9909726d
26 Jun, 2025 2 commits
- [Misc] Use collapsible blocks for benchmark examples. (#20017) · 167aca45
  Reid authored Jun 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  167aca45
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
25 Jun, 2025 2 commits
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
24 Jun, 2025 4 commits

[Feature] Integrate new deepgemm (#19820) · c6e3bba8
Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
c6e3bba8

[Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7

d.transposed authored Jun 24, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>

c635c5f7

add some examples for other benchmark scripts (#19893) · 3014c920

Reid authored Jun 24, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

3014c920

[Misc][Tools][Benchmark] Add profile to autotune script (#19711) · ee5ad8d2
Chenyaaang authored Jun 23, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
ee5ad8d2

23 Jun, 2025 2 commits
- [Bugfix][Benchmark] Fix Marlin benchmark (#19929) · 4671ac6e
  22quinn authored Jun 23, 2025
  
  4671ac6e
- update bench run error · f246ee95
  zhuwenwen authored Jun 23, 2025
  
  f246ee95
22 Jun, 2025 1 commit

[Benchmark] fix request loss if "ping" is returned (#19535) · 202c5df9

Wang, Yi authored Jun 22, 2025


Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

202c5df9

20 Jun, 2025 2 commits
- [Benchmark] Fix `Value of type "SampleRequest" is not indexable` (#18032) · 5aa4a015
  Brayden Zhong authored Jun 20, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  5aa4a015
- [Benchmark][Bugfix] Fix Dataset Length Calculation (#19868) · 10d82f9a
  Robert Shaw authored Jun 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  10d82f9a
19 Jun, 2025 1 commit

[Frontend] Expose custom args in OpenAI APIs (#16862) · dfada85e

afeldman-nm authored Jun 18, 2025


Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

dfada85e

17 Jun, 2025 1 commit
- [Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) · ffb2cd6b
  Wentao Ye authored Jun 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  ffb2cd6b
15 Jun, 2025 1 commit
- [Benchmark] Refactor benchmark script for fp8 & int8 (#19627) · 3d330c4c
  Wentao Ye authored Jun 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3d330c4c
14 Jun, 2025 1 commit
- [Misc] Modularize CLI Argument Parsing in Benchmark Scripts (#19593) · 6fa718a4
  Reid authored Jun 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  6fa718a4
12 Jun, 2025 1 commit
- [Perf] Vectorize static / dynamic INT8 quant kernels (#19233) · b6efafd9
  Wentao Ye authored Jun 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b6efafd9