Commits · 7c9697178ed3e15dbb7d4e3a66d5e52fd2caa180 · change / sglang

28 Jul, 2025 1 commit
- [CI]Add genai-bench Performance Validation for PD Router (#8477) · 7c969717
  Keyang Ru authored Jul 28, 2025
```
Co-authored-by: key4ng <rukeyang@gamil.com>
```
  7c969717
25 Jul, 2025 1 commit
- chore: upgrade mooncake 0.3.5 (#8341) · 70e37b97
  Shangming Cai authored Jul 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  70e37b97
24 Jul, 2025 1 commit
- [AMD] Pull latest image for AMD CI (#8070) · 0e5fa677
  michael-amd authored Jul 23, 2025
  
  0e5fa677
20 Jul, 2025 1 commit
- [feature] enable NPU CI (#7935) · 93d124ef
  ronnie_zheng authored Jul 20, 2025
```
Co-authored-by: Even Zhou <14368888+iforgetmyname@users.noreply.github.com>
```
  93d124ef
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

17 Jul, 2025 1 commit
- [ci] recover 8-gpu deepep test (#8105) · 02404a1e
  Cheng Wan authored Jul 17, 2025
  
  02404a1e
15 Jul, 2025 1 commit
- Update amd docker image. (#8045) · f06bd210
  Sai Enduri authored Jul 15, 2025
```
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
```
  f06bd210
14 Jul, 2025 1 commit
- [ci] CI supports use cached models (#7874) · 2117f82d
  Hank Han authored Jul 14, 2025
  
  2117f82d
09 Jul, 2025 1 commit
- [CI] Add deepep tests to CI (#7872) · d487555f
  Cheng Wan authored Jul 09, 2025
  
  d487555f
04 Jul, 2025 1 commit
- [fix] update bench_speculative.py for compatibility (#7764) · 975a5ec6
  Kay Yan authored Jul 04, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  975a5ec6
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
29 Jun, 2025 1 commit
- [AMD] Add unit-test-sgl-kernel-amd to AMD CI (#7539) · 3b3f1e3a
  Hubert Lu authored Jun 29, 2025
  
  3b3f1e3a
27 Jun, 2025 1 commit
- [CI] Add CI Testing for Prefill-Decode Disaggregation with Router (#7540) · 29bd4c81
  Keyang Ru authored Jun 27, 2025
  
  29bd4c81
26 Jun, 2025 1 commit
- chore: improve ci bug reporting (#7542) · 4d67025a
  Mick authored Jun 26, 2025
  
  4d67025a
25 Jun, 2025 1 commit
- [CI] Upgrade mooncake to v0.3.4.post2 to fix potential slice failed bug (#7522) · a07f8ae4
  Shangming Cai authored Jun 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  a07f8ae4
23 Jun, 2025 1 commit
- [CI] Upgrade mooncake to 0.3.4.post1 to fix 8 gpu tests (#7472) · d6dddc19
  Shangming Cai authored Jun 24, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d6dddc19
22 Jun, 2025 1 commit

Fix torch compile run (#7391) · bd4f5818

kk authored Jun 23, 2025


Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>

bd4f5818

20 Jun, 2025 1 commit
- [PD] Optimize custom mem pool usage and bump mooncake version (#7393) · 187b85b7
  Shangming Cai authored Jun 21, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  187b85b7
11 Jun, 2025 1 commit
- Do not run frontend_reasoning.ipynb to reduce the CI load (#7073) · 0f218731
  Lianmin Zheng authored Jun 10, 2025
  
  0f218731
09 Jun, 2025 1 commit

chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2

Yineng Zhang authored Jun 09, 2025


Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>

56ccd3c2

08 Jun, 2025 1 commit
- [AMD] Add more tests to per-commit-amd (#6926) · 47402883
  Hubert Lu authored Jun 08, 2025
  
  47402883
06 Jun, 2025 1 commit
- AITER backend extension and workload optimizations (#6838) · b819381f
  HAI authored Jun 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  b819381f
02 Jun, 2025 1 commit
- Correctly abort the failed grammar requests & Improve the handling of abort (#6803) · 20fd53b8
  Lianmin Zheng authored Jun 01, 2025
  
  20fd53b8
28 May, 2025 1 commit
- Update amd docker and nightly models. (#6687) · f4a8987f
  Sai Enduri authored May 28, 2025
  
  f4a8987f
27 May, 2025 1 commit
- chore: upgrade mooncake-transfer-engine (#6643) · f77da699
  Yineng Zhang authored May 26, 2025
  
  f77da699
26 May, 2025 3 commits
- Update nightly thresholds and dependencies. (#6635) · eb8f02dd
  Sai Enduri authored May 26, 2025
  
  eb8f02dd
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
- Tiny change killall_sglang.sh (#6596) · d502dae0
  fzyzcjy authored May 26, 2025
  
  d502dae0
24 May, 2025 2 commits
- Fix GPU OOM (#6564) · 7a5e6ce1
  kk authored May 25, 2025
```
Co-authored-by: michael <michael.zhang@amd.com>
```
  7a5e6ce1
- [PD] Support structured output (#6560) · 2d831c6e
  Byron Hsu authored May 23, 2025
  
  2d831c6e
23 May, 2025 1 commit
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
21 May, 2025 1 commit
- aiter attention-backend (default enabled on AMD/ROCm) (#6381) · 5c0b38f3
  HAI authored May 20, 2025
  
  5c0b38f3
18 May, 2025 2 commits
- feat: add long context example (#6391) · eabcf82a
  Yineng Zhang authored May 18, 2025
  
  eabcf82a
- Clean up AMD CI (#6365) · c47a51db
  Sai Enduri authored May 18, 2025
  
  c47a51db
16 May, 2025 1 commit
- Fix amd ci (#6360) · dcc0a456
  Lianmin Zheng authored May 16, 2025
  
  dcc0a456
15 May, 2025 1 commit
- Minor improvements of TokenizerManager / health check (#6327) · e07a6977
  Lianmin Zheng authored May 15, 2025
  
  e07a6977
13 May, 2025 1 commit
- [VERL Use Case] Add torch_memory_saver into deps (#6247) · 1ab14c4c
  Stefan He authored May 12, 2025
  
  1ab14c4c
12 May, 2025 2 commits
- chore: add hf_xet dep (#6243) · f94543d2
  Yineng Zhang authored May 12, 2025
  
  f94543d2
- [CI] Fix PD mooncake dependency error (#6212) · 0f334945
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  0f334945
11 May, 2025 1 commit
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f