Commits · 0b07c4a99f8a24a8a99510220d4252472ca5a81b · change / sglang · GitLab

22 May, 2025 1 commit
- chore: upgrade sgl-kernel v0.1.4 (#6532) · 0b07c4a9
  Yineng Zhang authored May 22, 2025
  
  0b07c4a9
18 May, 2025 1 commit
- Add 4-GPU runner tests and split existing tests (#6383) · f11481b9
  fzyzcjy authored May 19, 2025
  
  f11481b9
14 May, 2025 1 commit
- Enable unit tests for AMD CI. (#6283) · 73eb67c0
  Sai Enduri authored May 14, 2025
  
  73eb67c0
12 May, 2025 3 commits
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- [CI] Re-enable pd disaggregation test (#6231) · 3ee40ff9
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ee40ff9
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
11 May, 2025 3 commits
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- [CI] Disabled deepep tests temporarily because it takes too much time. (#6186) · 17c36c55
  Lianmin Zheng authored May 10, 2025
  
  17c36c55
- [PD] Add simple unit test for disaggregation feature (#5654) · 31d1f6e7
  shangmingc authored May 11, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  31d1f6e7
10 May, 2025 1 commit
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
09 May, 2025 1 commit
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
08 May, 2025 1 commit
- Clean up fa3 test from 8 gpus (#6105) · 24c13ca9
  Stefan He authored May 07, 2025
  
  24c13ca9
07 May, 2025 1 commit
- Add DeepEP to CI PR Test (#5655) · 8a828666
  Jinyan Chen authored May 07, 2025
```
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
```
  8a828666
06 May, 2025 1 commit
- [Fix] Fix and rename flashmla CI test (#6045) · bdd17998
  Baizhou Zhang authored May 06, 2025
  
  bdd17998
05 May, 2025 1 commit
- [Test] Add flashmla attention backend test (#5587) · b8559764
  Huapeng Zhou authored May 06, 2025
  
  b8559764
01 May, 2025 2 commits
- fix: correct stream response when enable_thinking is set to false (#5881) · 256c4c25
  mlmz authored May 01, 2025
  
  256c4c25
- [PP] Add pipeline parallelism (#5724) · 11383cec
  Ying Sheng authored Apr 30, 2025
  
  11383cec
30 Apr, 2025 2 commits
- Add AMD MI300x Nightly Testing. (#5861) · e3a53044
  saienduri authored Apr 29, 2025
  
  e3a53044
- feat: support pythonic tool call and index in tool call streaming (#5725) · 2b06484b
  Chang Su authored Apr 29, 2025
  
  2b06484b
29 Apr, 2025 2 commits
- [CI] Add test_function_calling.py to run_suite.py (#5896) · 9419e75d
  Chang Su authored Apr 29, 2025
  
  9419e75d
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
27 Apr, 2025 10 commits
- [CI] Improve github summary & enable fa3 for more models (#5796) · daed453e
  Lianmin Zheng authored Apr 27, 2025
  
  daed453e
- Add 8-GPU Test for Deepseek-V3 (#5691) · f9fb33ef
  Baizhou Zhang authored Apr 27, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  f9fb33ef
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
- [CI] fix port conflicts (#5789) · 35ca04d2
  Lianmin Zheng authored Apr 27, 2025
  
  35ca04d2
- [CI] Tune threshold (#5787) · 3c4e0ee6
  Lianmin Zheng authored Apr 27, 2025
  
  3c4e0ee6
- Simplify FA3 tests (#5779) · 4d23ba08
  Lianmin Zheng authored Apr 27, 2025
  
  4d23ba08
- Split local attention test from fa3 test (#5774) · a45a4b23
  Baizhou Zhang authored Apr 27, 2025
  
  a45a4b23
- Fix eagle test case (#5776) · 981a2619
  Lianmin Zheng authored Apr 27, 2025
  
  981a2619
- Add Llama 4 to FA3 test (#5509) · 408ba022
  Stefan He authored Apr 26, 2025
  
  408ba022
- CI: rewrite test_vision_chunked_prefill to speedup (#5682) · 02723e1b
  Mick authored Apr 27, 2025
  
  02723e1b
25 Apr, 2025 1 commit
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
21 Apr, 2025 1 commit

Add Speculative Decoding Eagle3 topk > 1 (#5318) · 188f0955

Qingquan Song authored Apr 20, 2025


Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Yubo Wang <yubowang2019@gmail.com>

188f0955

19 Apr, 2025 1 commit
- restruct compressed_tensors_w8a8_fp8 (#5475) · bf86c5e9
  Xiaoyu Zhang authored Apr 19, 2025
  
  bf86c5e9
14 Apr, 2025 1 commit
- Support for Qwen2.5-VL Model in bitsandbytes Format (#5003) · 072df753
  yhyang201 authored Apr 14, 2025
  
  072df753
09 Apr, 2025 2 commits
- [ci] fix ci test fused_moe op (#5102) · 87eddedf
  Xiaoyu Zhang authored Apr 09, 2025
  
  87eddedf
- Support Llama4 fp8 inference (#5194) · 40652482
  HandH1998 authored Apr 09, 2025
```
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>
```
  40652482
08 Apr, 2025 1 commit
- Add unit test on page_size > 1 and mla and integration test for Flash Attention 3 (#4760) · 804d9f2e
  Yubo Wang authored Apr 07, 2025
  
  804d9f2e
30 Mar, 2025 1 commit
- Fix 2-gpu CI test and suppress some warnings (#4930) · 9adf178c
  Lianmin Zheng authored Mar 30, 2025
  
  9adf178c