Commits · cbbd685a46cd9345c0a87f243292c3ea59e5db32 · change / sglang

06 Aug, 2025 4 commits
- chore: use torch 2.8 stable (#8880) · cbbd685a
  Yineng Zhang authored Aug 06, 2025
  
  cbbd685a
- [CI] fix pip upgrade (#8881) · 78aad910
  Cheng Wan authored Aug 06, 2025
  
  78aad910
- Support B200 in CI (#8861) · b114a810
  fzyzcjy authored Aug 06, 2025
  
  b114a810
- chore: upgrade torch 2.8.0 (#8836) · 3ae8e3ea
  Yineng Zhang authored Aug 05, 2025
  
  3ae8e3ea
05 Aug, 2025 1 commit
- Fix potential memory fault issue and ncclSystemError in CI test (#8681) · 32d9e39a
  kk authored Aug 06, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  32d9e39a
04 Aug, 2025 1 commit
- [CI] Ascend NPU CI enhancement (#8294) · fee0ab0f
  Even Zhou authored Aug 04, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  fee0ab0f
01 Aug, 2025 1 commit

chore: speedup NPU CI by cache (#8270) · fe5086fd

li chaoran authored Aug 01, 2025


Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>

fe5086fd

28 Jul, 2025 1 commit
- [CI]Add genai-bench Performance Validation for PD Router (#8477) · 7c969717
  Keyang Ru authored Jul 28, 2025
```
Co-authored-by: key4ng <rukeyang@gamil.com>
```
  7c969717
25 Jul, 2025 1 commit
- chore: upgrade mooncake 0.3.5 (#8341) · 70e37b97
  Shangming Cai authored Jul 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  70e37b97
24 Jul, 2025 1 commit
- [AMD] Pull latest image for AMD CI (#8070) · 0e5fa677
  michael-amd authored Jul 23, 2025
  
  0e5fa677
20 Jul, 2025 1 commit
- [feature] enable NPU CI (#7935) · 93d124ef
  ronnie_zheng authored Jul 20, 2025
```
Co-authored-by: Even Zhou <14368888+iforgetmyname@users.noreply.github.com>
```
  93d124ef
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

17 Jul, 2025 1 commit
- [ci] recover 8-gpu deepep test (#8105) · 02404a1e
  Cheng Wan authored Jul 17, 2025
  
  02404a1e
15 Jul, 2025 1 commit
- Update amd docker image. (#8045) · f06bd210
  Sai Enduri authored Jul 15, 2025
```
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
```
  f06bd210
14 Jul, 2025 1 commit
- [ci] CI supports use cached models (#7874) · 2117f82d
  Hank Han authored Jul 14, 2025
  
  2117f82d
09 Jul, 2025 1 commit
- [CI] Add deepep tests to CI (#7872) · d487555f
  Cheng Wan authored Jul 09, 2025
  
  d487555f
04 Jul, 2025 1 commit
- [fix] update bench_speculative.py for compatibility (#7764) · 975a5ec6
  Kay Yan authored Jul 04, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  975a5ec6
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
29 Jun, 2025 1 commit
- [AMD] Add unit-test-sgl-kernel-amd to AMD CI (#7539) · 3b3f1e3a
  Hubert Lu authored Jun 29, 2025
  
  3b3f1e3a
27 Jun, 2025 1 commit
- [CI] Add CI Testing for Prefill-Decode Disaggregation with Router (#7540) · 29bd4c81
  Keyang Ru authored Jun 27, 2025
  
  29bd4c81
26 Jun, 2025 1 commit
- chore: improve ci bug reporting (#7542) · 4d67025a
  Mick authored Jun 26, 2025
  
  4d67025a
25 Jun, 2025 1 commit
- [CI] Upgrade mooncake to v0.3.4.post2 to fix potential slice failed bug (#7522) · a07f8ae4
  Shangming Cai authored Jun 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  a07f8ae4
23 Jun, 2025 1 commit
- [CI] Upgrade mooncake to 0.3.4.post1 to fix 8 gpu tests (#7472) · d6dddc19
  Shangming Cai authored Jun 24, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d6dddc19
22 Jun, 2025 1 commit

Fix torch compile run (#7391) · bd4f5818

kk authored Jun 23, 2025


Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>

bd4f5818

20 Jun, 2025 1 commit
- [PD] Optimize custom mem pool usage and bump mooncake version (#7393) · 187b85b7
  Shangming Cai authored Jun 21, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  187b85b7
11 Jun, 2025 1 commit
- Do not run frontend_reasoning.ipynb to reduce the CI load (#7073) · 0f218731
  Lianmin Zheng authored Jun 10, 2025
  
  0f218731
09 Jun, 2025 1 commit

chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2

Yineng Zhang authored Jun 09, 2025


Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>

56ccd3c2

08 Jun, 2025 1 commit
- [AMD] Add more tests to per-commit-amd (#6926) · 47402883
  Hubert Lu authored Jun 08, 2025
  
  47402883
06 Jun, 2025 1 commit
- AITER backend extension and workload optimizations (#6838) · b819381f
  HAI authored Jun 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  b819381f
02 Jun, 2025 1 commit
- Correctly abort the failed grammar requests & Improve the handling of abort (#6803) · 20fd53b8
  Lianmin Zheng authored Jun 01, 2025
  
  20fd53b8
28 May, 2025 1 commit
- Update amd docker and nightly models. (#6687) · f4a8987f
  Sai Enduri authored May 28, 2025
  
  f4a8987f
27 May, 2025 1 commit
- chore: upgrade mooncake-transfer-engine (#6643) · f77da699
  Yineng Zhang authored May 26, 2025
  
  f77da699
26 May, 2025 3 commits
- Update nightly thresholds and dependencies. (#6635) · eb8f02dd
  Sai Enduri authored May 26, 2025
  
  eb8f02dd
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
- Tiny change killall_sglang.sh (#6596) · d502dae0
  fzyzcjy authored May 26, 2025
  
  d502dae0
24 May, 2025 2 commits
- Fix GPU OOM (#6564) · 7a5e6ce1
  kk authored May 25, 2025
```
Co-authored-by: michael <michael.zhang@amd.com>
```
  7a5e6ce1
- [PD] Support structured output (#6560) · 2d831c6e
  Byron Hsu authored May 23, 2025
  
  2d831c6e
23 May, 2025 1 commit
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
21 May, 2025 1 commit
- aiter attention-backend (default enabled on AMD/ROCm) (#6381) · 5c0b38f3
  HAI authored May 20, 2025
  
  5c0b38f3
18 May, 2025 1 commit
- feat: add long context example (#6391) · eabcf82a
  Yineng Zhang authored May 18, 2025
  
  eabcf82a