Commits · 25c83fff6a80d9e3d2749f2ead122f96fdc127e9 · change / sglang

"test/srt/cpu/test_norm.py" did not exist on "3ded6235c9e423d39cb12e7fd3453c714e7a33ef"

12 May, 2025 3 commits
- Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558) · 25c83fff
  Cheng Wan authored May 12, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
```
  25c83fff
- [doc] add a note for --n-share-experts-fusion args (#6154) · 9f2c9568
  Xiaoyu Zhang authored May 12, 2025
  
  9f2c9568
- Fix start_profile does not support with_stack and record_shapes (#6043) · 3f2702ae
  fzyzcjy authored May 12, 2025
  
  3f2702ae
11 May, 2025 22 commits
- Fix release-docs.yml to not use python 3.9 (#6204) · 6ea05950
  Lianmin Zheng authored May 11, 2025
  
  6ea05950
- Update README.md (#6202) · e7dd906c
  Lianmin Zheng authored May 11, 2025
  
  e7dd906c
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- Add dev-deepep docker image (#6198) · e9a47f4c
  fzyzcjy authored May 12, 2025
  
  e9a47f4c
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- Improve structured outputs: fix race condition, server crash, metrics and style (#6188) · 01bdbf7f
  Lianmin Zheng authored May 11, 2025
  
  01bdbf7f
- [Docs] minor Qwen3 and reasoning parser docs fix (#6032) · 94d42b67
  Adarsh Shirawalmath authored May 11, 2025
  
  94d42b67
- doc: fix the erroneous documents and example codes about... · 69276f61
  mlmz authored May 11, 2025
```
doc: fix the erroneous documents and example codes about Alibaba-NLP/gme-Qwen2-VL-2B-Instruct (#6199)
```
  69276f61
- Handle empty input string for embedding models (#5621) · 41a645f5
  Ravi Theja authored May 11, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  41a645f5
- chore: upgrade sgl-kernel v0.1.2.post1 (#6196) · 23010630
  Yineng Zhang authored May 11, 2025
```
Co-authored-by: alcanderian <alcanderian@gmail.com>
```
  23010630
- chore: bump sgl-kernel v0.1.2.post1 (#6195) · 45b4dcf0
  Yineng Zhang authored May 11, 2025
  
  45b4dcf0
- chore: upgrade deepgemm (#6073) · 213e8c7d
  Yineng Zhang authored May 11, 2025
  
  213e8c7d
- fix: handle None multimodal_inputs during merging and filtering batches in... · 41273fd7
  Yusong Gao authored May 11, 2025
```
fix: handle None multimodal_inputs during merging and filtering batches in disaggregation decode mode (#6169)
```
  41273fd7
- [fix] remove mixtral from is_fa3_default_architecture (#6191) · e9bebafb
  JieXin Liang authored May 11, 2025
  
  e9bebafb
- feat: support loogle eval (#6190) · 4d1c9db6
  Yineng Zhang authored May 10, 2025
  
  4d1c9db6
- [CI] Disabled deepep tests temporarily because it takes too much time. (#6186) · 17c36c55
  Lianmin Zheng authored May 10, 2025
  
  17c36c55
- [PD] Add simple unit test for disaggregation feature (#5654) · 31d1f6e7
  shangmingc authored May 11, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  31d1f6e7
- Remove duplicate IO Struct test (#6180) · a823c6e8
  Emmanuel Ferdman authored May 11, 2025
```
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
```
  a823c6e8
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
- Fix request abortion (#6184) · de167cf5
  Lianmin Zheng authored May 10, 2025
  
  de167cf5
- Fix data parallel perf regression (#6183) · 4319978c
  Lianmin Zheng authored May 10, 2025
  
  4319978c
- Added async_encode method to Engine (#4701) · 03dd785c
  Steven Shimizu authored May 10, 2025
  
  03dd785c
10 May, 2025 4 commits
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
- [Docs]Delete duplicate content (#6146) · 921e4a81
  Ximingwang-09 authored May 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  921e4a81
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
- [fix] fix determine_n_share_experts_fusion (#6118) · c178abda
  JieXin Liang authored May 10, 2025
  
  c178abda
09 May, 2025 9 commits
- KV‑Cache (MHA, MLA): add missing start_layer / end_layer fields to... · b29a026e
  Simon (Jiyou) Li authored May 10, 2025
```
KV‑Cache (MHA, MLA): add missing start_layer / end_layer fields to MHATokenToKVPoolHost and MLATokenToKVPoolHost (#6016)
Co-authored-by: 继优 <jiyou.ljy@alibaba-inc.com>
Co-authored-by: chus-chus <chus-chus@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  b29a026e
- chore: bump v0.4.6.post3 (#6165) · 678d8cc9
  Yineng Zhang authored May 09, 2025
  
  678d8cc9
- fix bug that gpu0 occupies more memory when hicache is turned on (#5778) · d2cb3024
  huangtingwei authored May 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  d2cb3024
- [Bugfix] Fix Llama4 gibberish output with long context and CUDA graph (#6162) · 1940cdec
  Chang Su authored May 09, 2025
  
  1940cdec
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
- Update amd nightly concurrency. (#6141) · dff0ab92
  Sai Enduri authored May 09, 2025
  
  dff0ab92
- opt flashinfer mla cat (#5822) · e30c273b
  xu-yfei authored May 09, 2025
```
Co-authored-by: xuyongfei.xyf <xuyongfei.xyf@antgroup.com>
```
  e30c273b
- Cutlass MLA: Disable split kv due to https://github.com/NVIDIA/cutlass/issues/2274 (#6101) · 0ab3f437
  Trevor Morris authored May 08, 2025
  
  0ab3f437
- [Fix] Incorrect Memory Allocation on CUDA:0 by Non-Zero CUDA Processes in TP/DP (#5745) · cec98f10
  yhyang201 authored May 09, 2025
  
  cec98f10
08 May, 2025 2 commits
- docs: update README (#6132) · 8dc4efd0
  Yineng Zhang authored May 08, 2025
  
  8dc4efd0
- chore: bump sgl-kernel 0.1.2 (#6131) · 6578cf27
  Yineng Zhang authored May 08, 2025
  
  6578cf27