Commits · 187b85b7f38496653948a2aba546d53c09ada0f3 · change / sglang

20 Jun, 2025 1 commit
- [PD] Optimize custom mem pool usage and bump mooncake version (#7393) · 187b85b7
  Shangming Cai authored Jun 21, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  187b85b7
11 Jun, 2025 1 commit
- Do not run frontend_reasoning.ipynb to reduce the CI load (#7073) · 0f218731
  Lianmin Zheng authored Jun 10, 2025
  
  0f218731
09 Jun, 2025 1 commit

chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2

Yineng Zhang authored Jun 09, 2025


Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>

56ccd3c2

08 Jun, 2025 1 commit
- [AMD] Add more tests to per-commit-amd (#6926) · 47402883
  Hubert Lu authored Jun 08, 2025
  
  47402883
06 Jun, 2025 1 commit
- AITER backend extension and workload optimizations (#6838) · b819381f
  HAI authored Jun 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  b819381f
02 Jun, 2025 1 commit
- Correctly abort the failed grammar requests & Improve the handling of abort (#6803) · 20fd53b8
  Lianmin Zheng authored Jun 01, 2025
  
  20fd53b8
28 May, 2025 1 commit
- Update amd docker and nightly models. (#6687) · f4a8987f
  Sai Enduri authored May 28, 2025
  
  f4a8987f
27 May, 2025 1 commit
- chore: upgrade mooncake-transfer-engine (#6643) · f77da699
  Yineng Zhang authored May 26, 2025
  
  f77da699
26 May, 2025 3 commits
- Update nightly thresholds and dependencies. (#6635) · eb8f02dd
  Sai Enduri authored May 26, 2025
  
  eb8f02dd
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
- Tiny change killall_sglang.sh (#6596) · d502dae0
  fzyzcjy authored May 26, 2025
  
  d502dae0
24 May, 2025 2 commits
- Fix GPU OOM (#6564) · 7a5e6ce1
  kk authored May 25, 2025
```
Co-authored-by: michael <michael.zhang@amd.com>
```
  7a5e6ce1
- [PD] Support structured output (#6560) · 2d831c6e
  Byron Hsu authored May 23, 2025
  
  2d831c6e
23 May, 2025 1 commit
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
21 May, 2025 1 commit
- aiter attention-backend (default enabled on AMD/ROCm) (#6381) · 5c0b38f3
  HAI authored May 20, 2025
  
  5c0b38f3
18 May, 2025 2 commits
- feat: add long context example (#6391) · eabcf82a
  Yineng Zhang authored May 18, 2025
  
  eabcf82a
- Clean up AMD CI (#6365) · c47a51db
  Sai Enduri authored May 18, 2025
  
  c47a51db
16 May, 2025 1 commit
- Fix amd ci (#6360) · dcc0a456
  Lianmin Zheng authored May 16, 2025
  
  dcc0a456
15 May, 2025 1 commit
- Minor improvements of TokenizerManager / health check (#6327) · e07a6977
  Lianmin Zheng authored May 15, 2025
  
  e07a6977
13 May, 2025 1 commit
- [VERL Use Case] Add torch_memory_saver into deps (#6247) · 1ab14c4c
  Stefan He authored May 12, 2025
  
  1ab14c4c
12 May, 2025 2 commits
- chore: add hf_xet dep (#6243) · f94543d2
  Yineng Zhang authored May 12, 2025
  
  f94543d2
- [CI] Fix PD mooncake dependency error (#6212) · 0f334945
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  0f334945
11 May, 2025 4 commits
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- chore: upgrade sgl-kernel v0.1.2.post1 (#6196) · 23010630
  Yineng Zhang authored May 11, 2025
```
Co-authored-by: alcanderian <alcanderian@gmail.com>
```
  23010630
- [PD] Add simple unit test for disaggregation feature (#5654) · 31d1f6e7
  shangmingc authored May 11, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  31d1f6e7
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
07 May, 2025 1 commit
- Add DeepEP to CI PR Test (#5655) · 8a828666
  Jinyan Chen authored May 07, 2025
```
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
```
  8a828666
05 May, 2025 1 commit
- [Test] Add flashmla attention backend test (#5587) · b8559764
  Huapeng Zhou authored May 06, 2025
  
  b8559764
30 Apr, 2025 1 commit
- chore: upgrade sgl-kernel 0.1.1 (#5933) · 9a6ad891
  Yineng Zhang authored Apr 30, 2025
  
  9a6ad891
28 Apr, 2025 1 commit
- chore: upgrade sgl-kernel 0.1.0 (#5690) · 41ac0c6d
  Yineng Zhang authored Apr 27, 2025
  
  41ac0c6d
25 Apr, 2025 2 commits
- Pin torch audio to 2.6.0 (#5750) · 3dd3538c
  Lianmin Zheng authored Apr 25, 2025
  
  3dd3538c
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
22 Apr, 2025 1 commit
- fix: update bench_speculative (#5649) · 7282ab74
  Yineng Zhang authored Apr 22, 2025
  
  7282ab74
21 Apr, 2025 3 commits
- [PD] Support prefill overlap + Ensure no race condition (#5609) · bf98d2e3
  Byron Hsu authored Apr 21, 2025
  
  bf98d2e3
- [PD] Fix edge case and simplify large page size + chunked prefill (#5589) · deded17f
  Byron Hsu authored Apr 21, 2025
  
  deded17f
- [PD] Fix large page size + chunk prefill (#5588) · c951d312
  Byron Hsu authored Apr 20, 2025
  
  c951d312
20 Apr, 2025 1 commit
- [Feat] upgrade pytorch2.6 (#5417) · 417b44eb
  lukec authored Apr 21, 2025
  
  417b44eb
19 Apr, 2025 2 commits
- feat: use flashinfer jit package (#5547) · 0961feef
  Yineng Zhang authored Apr 19, 2025
  
  0961feef
- chore: upgrade sgl-kernel 0.0.9.post2 (#5540) · 2c11f9c2
  Yineng Zhang authored Apr 18, 2025
  
  2c11f9c2
17 Apr, 2025 1 commit
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd