Commits · 7349717e4b20e754cefca855185bae87342ce0c9 · change / sglang · GitLab

01 Jul, 2025 1 commit
- [doc] update lws doc for pd (#7318) · 7349717e
  ybyang authored Jul 01, 2025
  
  7349717e
30 Jun, 2025 5 commits
- chore: upgrade flashinfer v0.2.7 jit (#7663) · 392e441a
  Yineng Zhang authored Jun 30, 2025
  
  392e441a
- Add dsv3 router gemm kernel (#7627) · 7248272c
  Baizhou Zhang authored Jun 29, 2025
  
  7248272c
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
- [CPU] add c++ kernel to bind CPU cores and memory node (#7524) · c5131f7a
  Chunyuan WU authored Jun 30, 2025
  
  c5131f7a
- [EAGLE] remove a wrong adjustment for page_size > 1 & topk > 1 in server_args.py (#7643) · 78700893
  Lianmin Zheng authored Jun 29, 2025
  
  78700893
29 Jun, 2025 11 commits
- Update CODEOWNERS (#7640) · 663c04f7
  Lianmin Zheng authored Jun 29, 2025
  
  663c04f7
- [AMD] Add unit-test-sgl-kernel-amd to AMD CI (#7539) · 3b3f1e3a
  Hubert Lu authored Jun 29, 2025
  
  3b3f1e3a
- [misc] reduce weird rope_scaling_factor warning (#7176) · b691dcc4
  JieXin Liang authored Jun 30, 2025
  
  b691dcc4
- Move files related to EPLB (#7580) · 0c9c6c75
  fzyzcjy authored Jun 30, 2025
  
  0c9c6c75
- [bugfix] fix runtime dropping panic in editable (#7628) · e3f9b548
  Simo Lin authored Jun 29, 2025
  
  e3f9b548
- Fix sgl-router startup crash (#7619) · b3cff365
  finetune authored Jun 29, 2025
  
  b3cff365
- Fix stream reasoning parser and Adds Kimi reasoning parser (#7432) · 8f335b5b
  Xinyuan Tong authored Jun 29, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8f335b5b
- Add @mickqian as the CODEOWNERS of multimodal (#7636) · b2264076
  Lianmin Zheng authored Jun 29, 2025
  
  b2264076
- Add dsv3 fused a gemm to sgl-kernel (#7630) · 04b35190
  Ke Bao authored Jun 29, 2025
  
  04b35190
- [Minor] clean up multimodal processor and tokenizer manager (#7624) · 071a1f51
  Lianmin Zheng authored Jun 29, 2025
  
  071a1f51
- [bugfix] Remove PR comment posting from Rust benchmark workflow (#7625) · 7c0db3a6
  Simo Lin authored Jun 28, 2025
  
  7c0db3a6
28 Jun, 2025 13 commits
- oai: Adds support for OpenAI chat completions API in bench_serving (#7036) · c45e49d8
  Xinyuan Tong authored Jun 28, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  c45e49d8
- docs: add gb200 nvl72 and a16z grant (#7620) · d8053929
  Yineng Zhang authored Jun 28, 2025
  
  d8053929
- Let EP prefill support new DeepGEMM (#7310) · 00c7b1ad
  fzyzcjy authored Jun 28, 2025
  
  00c7b1ad
- Let ep_scatter support arbitrary strides / ue8m0 format (#7309) · 82eccae4
  fzyzcjy authored Jun 28, 2025
  
  82eccae4
- fix unit tests (#7618) · a8c10aee
  Yineng Zhang authored Jun 28, 2025
  
  a8c10aee
- [PD] Respect sampling_params.max_new_tokens when PD disaggregation is activated (#7598) · eb429b88
  Shangming Cai authored Jun 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  eb429b88
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- [BUG] fix local_rank in initialize_dp_attention (#7584) · cfe2edac
  Sheng Qi authored Jun 28, 2025
  
  cfe2edac
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
- Tiny add logs for expert location updater (#7308) · 9efb2993
  fzyzcjy authored Jun 28, 2025
  
  9efb2993
- [CPU] add optimizations for INT8 and FP8 DeepSeek (#6769) · a5317b2f
  Chunyuan WU authored Jun 28, 2025
```
Co-authored-by: Zheng, Beilei <beilei.zheng@intel.com>
```
  a5317b2f
- Hybrid kv cache for LLaMA4 (#6563) · eb6c2c16
  tarinkk authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: tarinkk <rt572@physics.rutger.edu>
Co-authored-by: tarinkk <rt572@rutgers.physics.edu>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  eb6c2c16
- Fix: Minicpm (#7612) · 357921aa
  Xinyuan Tong authored Jun 27, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  357921aa
27 Jun, 2025 7 commits
- [router] add centralized configuration module for sgl-router (#7588) · c071198c
  Simo Lin authored Jun 27, 2025
  
  c071198c
- Fix broken CI TestVILAServer (#7610) · d7374d74
  Lifu Huang authored Jun 27, 2025
  
  d7374d74
- Move multimodal processors into a separate folder (#7581) · ce3a3e87
  Lianmin Zheng authored Jun 27, 2025
  
  ce3a3e87
- feat: support compatibility between MTP and two-batch-overlap (#7225) · 41650b0d
  Qiaolin Yu authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  41650b0d
- Updates transformers and timm dependencies (#7577) · 1b951620
  Xinyuan Tong authored Jun 27, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  1b951620
- [CI] Add CI Testing for Prefill-Decode Disaggregation with Router (#7540) · 29bd4c81
  Keyang Ru authored Jun 27, 2025
  
  29bd4c81
- Add e2e test for multi instance multi stage memory release/resume occupuation (#7208) · 031f64aa
  Ata Fatahi authored Jun 26, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  031f64aa
26 Jun, 2025 3 commits
- Fix MTP error when enabling two-batch overlap (#7569) · 3d7cdb2e
  fzyzcjy authored Jun 27, 2025
  
  3d7cdb2e
- Updates Gemma3n MLP layer to adapt latest transformers version (#7573) · 604efe07
  Xinyuan Tong authored Jun 26, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  604efe07
- [Fix] incorrect assert in EPLB (#7575) · 1b8cf77b
  Cheng Wan authored Jun 26, 2025
  
  1b8cf77b