Commits · 8e03b641baf12962ad71970c2578d5c85bb1cf61 · change / sglang · GitLab

02 Jul, 2025 4 commits
- [1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641
  AniZpZ authored Jul 02, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>
```
  8e03b641
- Fix GPTQMarlinMoE (#7697) · b3fa5dc3
  Kyungmin Lee authored Jul 02, 2025
  
  b3fa5dc3
- Apply dsv3_fused_a_gemm kernel (#7635) · 00aec6ad
  Ke Bao authored Jul 02, 2025
  
  00aec6ad
- Improve error handling for requests with unloaded LoRA path(s) (#7642) · 1a08358a
  Lifu Huang authored Jul 01, 2025
  
  1a08358a
01 Jul, 2025 6 commits
- chore: upgrade flashinfer v0.2.7.post1 (#7698) · f18a8fdd
  Yineng Zhang authored Jul 01, 2025
  
  f18a8fdd
- fix(model loader): use safe_open to prevent file handle leaks. (#7684) · a7efbb27
  Simon_CQK authored Jul 02, 2025
  
  a7efbb27
- upgrade sgl kernel to 0.2.1 for main (#7676) · f9eb04dd
  Zhiqiang Xie authored Jul 01, 2025
  
  f9eb04dd
- Refactor mm processors and Enable mixed modality processing (#7629) · 3a911b85
  Xinyuan Tong authored Jun 30, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  3a911b85
- support llama4 eagle3 (#6985) · 886d3449
  lukec authored Jul 01, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: Shenggui Li <somerlee.9@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  886d3449
- Fix: sync prepare_fp8_layer_for_marlin with latest vllm changes (#7648) · 3e34e900
  narutolhy authored Jun 30, 2025
  
  3e34e900
30 Jun, 2025 4 commits
- chore: upgrade flashinfer v0.2.7 jit (#7663) · 392e441a
  Yineng Zhang authored Jun 30, 2025
  
  392e441a
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
- [CPU] add c++ kernel to bind CPU cores and memory node (#7524) · c5131f7a
  Chunyuan WU authored Jun 30, 2025
  
  c5131f7a
- [EAGLE] remove a wrong adjustment for page_size > 1 & topk > 1 in server_args.py (#7643) · 78700893
  Lianmin Zheng authored Jun 29, 2025
  
  78700893
29 Jun, 2025 4 commits
- [misc] reduce weird rope_scaling_factor warning (#7176) · b691dcc4
  JieXin Liang authored Jun 30, 2025
  
  b691dcc4
- Move files related to EPLB (#7580) · 0c9c6c75
  fzyzcjy authored Jun 30, 2025
  
  0c9c6c75
- Fix stream reasoning parser and Adds Kimi reasoning parser (#7432) · 8f335b5b
  Xinyuan Tong authored Jun 29, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8f335b5b
- [Minor] clean up multimodal processor and tokenizer manager (#7624) · 071a1f51
  Lianmin Zheng authored Jun 29, 2025
  
  071a1f51
28 Jun, 2025 11 commits
- oai: Adds support for OpenAI chat completions API in bench_serving (#7036) · c45e49d8
  Xinyuan Tong authored Jun 28, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  c45e49d8
- Let EP prefill support new DeepGEMM (#7310) · 00c7b1ad
  fzyzcjy authored Jun 28, 2025
  
  00c7b1ad
- Let ep_scatter support arbitrary strides / ue8m0 format (#7309) · 82eccae4
  fzyzcjy authored Jun 28, 2025
  
  82eccae4
- [PD] Respect sampling_params.max_new_tokens when PD disaggregation is activated (#7598) · eb429b88
  Shangming Cai authored Jun 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  eb429b88
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- [BUG] fix local_rank in initialize_dp_attention (#7584) · cfe2edac
  Sheng Qi authored Jun 28, 2025
  
  cfe2edac
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
- Tiny add logs for expert location updater (#7308) · 9efb2993
  fzyzcjy authored Jun 28, 2025
  
  9efb2993
- [CPU] add optimizations for INT8 and FP8 DeepSeek (#6769) · a5317b2f
  Chunyuan WU authored Jun 28, 2025
```
Co-authored-by: Zheng, Beilei <beilei.zheng@intel.com>
```
  a5317b2f
- Hybrid kv cache for LLaMA4 (#6563) · eb6c2c16
  tarinkk authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: tarinkk <rt572@physics.rutger.edu>
Co-authored-by: tarinkk <rt572@rutgers.physics.edu>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  eb6c2c16
- Fix: Minicpm (#7612) · 357921aa
  Xinyuan Tong authored Jun 27, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  357921aa
27 Jun, 2025 4 commits
- Move multimodal processors into a separate folder (#7581) · ce3a3e87
  Lianmin Zheng authored Jun 27, 2025
  
  ce3a3e87
- feat: support compatibility between MTP and two-batch-overlap (#7225) · 41650b0d
  Qiaolin Yu authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  41650b0d
- Updates transformers and timm dependencies (#7577) · 1b951620
  Xinyuan Tong authored Jun 27, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  1b951620
- [CI] Add CI Testing for Prefill-Decode Disaggregation with Router (#7540) · 29bd4c81
  Keyang Ru authored Jun 27, 2025
  
  29bd4c81
26 Jun, 2025 7 commits
- Fix MTP error when enabling two-batch overlap (#7569) · 3d7cdb2e
  fzyzcjy authored Jun 27, 2025
  
  3d7cdb2e
- Updates Gemma3n MLP layer to adapt latest transformers version (#7573) · 604efe07
  Xinyuan Tong authored Jun 26, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  604efe07
- [Fix] incorrect assert in EPLB (#7575) · 1b8cf77b
  Cheng Wan authored Jun 26, 2025
  
  1b8cf77b
- [PD][NIXL] Set is_sorted=False to fix NIXL_ERR_NOT_FOUND (#7330) · bb9b608c
  Trevor Morris authored Jun 26, 2025
  
  bb9b608c
- chore: bump v0.4.8.post1 (#7559) · 69183f88
  Yineng Zhang authored Jun 26, 2025
  
  69183f88
- chore: remove vlm unnecessary import (#7541) · 9b00990b
  Xinyuan Tong authored Jun 26, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  9b00990b
- Add Tencent HunYuanMoEV1 model support (#7549) · 2390a2bc
  Meng, Peng authored Jun 26, 2025
  
  2390a2bc