Commits · 1ab14c4c5c67d0577451764f4a77d685a7dc2db4 · change / sglang

"docs/vscode:/vscode.git/clone" did not exist on "709cf554f69cd40c310a9bdb52a8d85dfc64c274"

13 May, 2025 2 commits
- [VERL Use Case] Add torch_memory_saver into deps (#6247) · 1ab14c4c
  Stefan He authored May 12, 2025
  
  1ab14c4c
- Skip the flaky test_stateful_custom_logit_processor (#6251) · ac2324c1
  Lianmin Zheng authored May 12, 2025
  
  ac2324c1
12 May, 2025 11 commits
- fix typo (#6248) · f24fc5b8
  Yineng Zhang authored May 12, 2025
  
  f24fc5b8
- Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225) · d18c6b33
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d18c6b33
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- chore: add hf_xet dep (#6243) · f94543d2
  Yineng Zhang authored May 12, 2025
  
  f94543d2
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [PP] Fix init_memory_pool desync & add PP for mixtral (#6223) · bad7c26f
  Ying Sheng authored May 12, 2025
  
  bad7c26f
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
- Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558) · 25c83fff
  Cheng Wan authored May 12, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
```
  25c83fff
- [doc] add a note for --n-share-experts-fusion args (#6154) · 9f2c9568
  Xiaoyu Zhang authored May 12, 2025
  
  9f2c9568
- Fix start_profile does not support with_stack and record_shapes (#6043) · 3f2702ae
  fzyzcjy authored May 12, 2025
  
  3f2702ae
11 May, 2025 13 commits
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- Improve structured outputs: fix race condition, server crash, metrics and style (#6188) · 01bdbf7f
  Lianmin Zheng authored May 11, 2025
  
  01bdbf7f
- Handle empty input string for embedding models (#5621) · 41a645f5
  Ravi Theja authored May 11, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  41a645f5
- chore: upgrade sgl-kernel v0.1.2.post1 (#6196) · 23010630
  Yineng Zhang authored May 11, 2025
```
Co-authored-by: alcanderian <alcanderian@gmail.com>
```
  23010630
- fix: handle None multimodal_inputs during merging and filtering batches in... · 41273fd7
  Yusong Gao authored May 11, 2025
```
fix: handle None multimodal_inputs during merging and filtering batches in disaggregation decode mode (#6169)
```
  41273fd7
- [fix] remove mixtral from is_fa3_default_architecture (#6191) · e9bebafb
  JieXin Liang authored May 11, 2025
  
  e9bebafb
- feat: support loogle eval (#6190) · 4d1c9db6
  Yineng Zhang authored May 10, 2025
  
  4d1c9db6
- [PD] Add simple unit test for disaggregation feature (#5654) · 31d1f6e7
  shangmingc authored May 11, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  31d1f6e7
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
- Fix request abortion (#6184) · de167cf5
  Lianmin Zheng authored May 10, 2025
  
  de167cf5
- Fix data parallel perf regression (#6183) · 4319978c
  Lianmin Zheng authored May 10, 2025
  
  4319978c
- Added async_encode method to Engine (#4701) · 03dd785c
  Steven Shimizu authored May 10, 2025
  
  03dd785c
10 May, 2025 3 commits
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
- [fix] fix determine_n_share_experts_fusion (#6118) · c178abda
  JieXin Liang authored May 10, 2025
  
  c178abda
09 May, 2025 7 commits
- KV‑Cache (MHA, MLA): add missing start_layer / end_layer fields to... · b29a026e
  Simon (Jiyou) Li authored May 10, 2025
```
KV‑Cache (MHA, MLA): add missing start_layer / end_layer fields to MHATokenToKVPoolHost and MLATokenToKVPoolHost (#6016)
Co-authored-by: 继优 <jiyou.ljy@alibaba-inc.com>
Co-authored-by: chus-chus <chus-chus@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  b29a026e
- chore: bump v0.4.6.post3 (#6165) · 678d8cc9
  Yineng Zhang authored May 09, 2025
  
  678d8cc9
- fix bug that gpu0 occupies more memory when hicache is turned on (#5778) · d2cb3024
  huangtingwei authored May 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  d2cb3024
- [Bugfix] Fix Llama4 gibberish output with long context and CUDA graph (#6162) · 1940cdec
  Chang Su authored May 09, 2025
  
  1940cdec
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
- opt flashinfer mla cat (#5822) · e30c273b
  xu-yfei authored May 09, 2025
```
Co-authored-by: xuyongfei.xyf <xuyongfei.xyf@antgroup.com>
```
  e30c273b
- [Fix] Incorrect Memory Allocation on CUDA:0 by Non-Zero CUDA Processes in TP/DP (#5745) · cec98f10
  yhyang201 authored May 09, 2025
  
  cec98f10
08 May, 2025 4 commits
- upgrade xgrammar to 0.1.19 (#6129) · 911f3ba6
  Yixin Dong authored May 08, 2025
  
  911f3ba6
- [AMD] switch to custom allreduce regardless of MSCCL setting on ROCm (#6097) · 2a936a84
  Hubert Lu authored May 08, 2025
  
  2a936a84
- [perf] dsv3 bmm fallback to bf16 (#5662) · 5e023301
  JieXin Liang authored May 09, 2025
  
  5e023301
- [Feature] Add FlashAttention3 as a backend for VisionAttention (#5764) · fa7d7fd9
  Zhu Chen authored May 09, 2025
```
Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  fa7d7fd9