Commits · b2e95f62b42692403bb691ae743f802e1eee7190 · change / sglang · GitLab

13 May, 2025 4 commits
- Fix two issues related to `--moe-dense-tp-size=1` (#5657) · b2e95f62
  Cheng Wan authored May 13, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: 颉沆 <xiehang.lsy@alibaba-inc.com>
```
  b2e95f62
- [VERL Use Case] Add torch_memory_saver into deps (#6247) · 1ab14c4c
  Stefan He authored May 12, 2025
  
  1ab14c4c
- [Llama4] Add docs note about enable multimodal (#6235) · 3c32895c
  Brayden Zhong authored May 12, 2025
  
  3c32895c
- Skip the flaky test_stateful_custom_logit_processor (#6251) · ac2324c1
  Lianmin Zheng authored May 12, 2025
  
  ac2324c1
12 May, 2025 17 commits
- Support tuning moe for llama 4 model (#6042) · ef8ec07b
  fzyzcjy authored May 13, 2025
  
  ef8ec07b
- fix typo (#6248) · f24fc5b8
  Yineng Zhang authored May 12, 2025
  
  f24fc5b8
- Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225) · d18c6b33
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d18c6b33
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- Update AMD nightly deps. (#6241) · 983c663d
  Sai Enduri authored May 12, 2025
  
  983c663d
- chore: add hf_xet dep (#6243) · f94543d2
  Yineng Zhang authored May 12, 2025
  
  f94543d2
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [PP] Fix init_memory_pool desync & add PP for mixtral (#6223) · bad7c26f
  Ying Sheng authored May 12, 2025
  
  bad7c26f
- [Docs] Add docs for `SGLANG_` and `SGL_` environment variables (#6206) · 12319a67
  Brayden Zhong authored May 12, 2025
  
  12319a67
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- [CI] Re-enable pd disaggregation test (#6231) · 3ee40ff9
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ee40ff9
- [CI] Fix PD mooncake dependency error (#6212) · 0f334945
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  0f334945
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
- Update AMD CI docker to v0.4.6.post3-rocm630. (#6213) · 7d3a3d45
  Sai Enduri authored May 12, 2025
  
  7d3a3d45
- Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558) · 25c83fff
  Cheng Wan authored May 12, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
```
  25c83fff
- [doc] add a note for --n-share-experts-fusion args (#6154) · 9f2c9568
  Xiaoyu Zhang authored May 12, 2025
  
  9f2c9568
- Fix start_profile does not support with_stack and record_shapes (#6043) · 3f2702ae
  fzyzcjy authored May 12, 2025
  
  3f2702ae
11 May, 2025 19 commits
- Fix release-docs.yml to not use python 3.9 (#6204) · 6ea05950
  Lianmin Zheng authored May 11, 2025
  
  6ea05950
- Update README.md (#6202) · e7dd906c
  Lianmin Zheng authored May 11, 2025
  
  e7dd906c
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- Add dev-deepep docker image (#6198) · e9a47f4c
  fzyzcjy authored May 12, 2025
  
  e9a47f4c
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- Improve structured outputs: fix race condition, server crash, metrics and style (#6188) · 01bdbf7f
  Lianmin Zheng authored May 11, 2025
  
  01bdbf7f
- [Docs] minor Qwen3 and reasoning parser docs fix (#6032) · 94d42b67
  Adarsh Shirawalmath authored May 11, 2025
  
  94d42b67
- doc: fix the erroneous documents and example codes about... · 69276f61
  mlmz authored May 11, 2025
```
doc: fix the erroneous documents and example codes about Alibaba-NLP/gme-Qwen2-VL-2B-Instruct (#6199)
```
  69276f61
- Handle empty input string for embedding models (#5621) · 41a645f5
  Ravi Theja authored May 11, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  41a645f5
- chore: upgrade sgl-kernel v0.1.2.post1 (#6196) · 23010630
  Yineng Zhang authored May 11, 2025
```
Co-authored-by: alcanderian <alcanderian@gmail.com>
```
  23010630
- chore: bump sgl-kernel v0.1.2.post1 (#6195) · 45b4dcf0
  Yineng Zhang authored May 11, 2025
  
  45b4dcf0
- chore: upgrade deepgemm (#6073) · 213e8c7d
  Yineng Zhang authored May 11, 2025
  
  213e8c7d
- fix: handle None multimodal_inputs during merging and filtering batches in... · 41273fd7
  Yusong Gao authored May 11, 2025
```
fix: handle None multimodal_inputs during merging and filtering batches in disaggregation decode mode (#6169)
```
  41273fd7
- [fix] remove mixtral from is_fa3_default_architecture (#6191) · e9bebafb
  JieXin Liang authored May 11, 2025
  
  e9bebafb
- feat: support loogle eval (#6190) · 4d1c9db6
  Yineng Zhang authored May 10, 2025
  
  4d1c9db6
- [CI] Disabled deepep tests temporarily because it takes too much time. (#6186) · 17c36c55
  Lianmin Zheng authored May 10, 2025
  
  17c36c55
- [PD] Add simple unit test for disaggregation feature (#5654) · 31d1f6e7
  shangmingc authored May 11, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  31d1f6e7
- Remove duplicate IO Struct test (#6180) · a823c6e8
  Emmanuel Ferdman authored May 11, 2025
```
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
```
  a823c6e8
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935