Commits · 570d33437bf0b4ac42e00ad468ddc43f9e0b376f · change / sglang · GitLab

16 Jul, 2025 1 commit
- update transformers to 4.53.2 (#8029) · 7498522f
  Xinyuan Tong authored Jul 15, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  7498522f
14 Jul, 2025 2 commits
- Support for Phi-1.5 & Phi-2 models (#7862) · cb736df8
  Praneth Paruchuri authored Jul 14, 2025
  
  cb736df8
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
13 Jul, 2025 2 commits
- chore: remove unnecessary limits on quantization methods in test script (#7997) · b5dd5e87
  Peng Zhang authored Jul 14, 2025
  
  b5dd5e87
- SWA Prefix Cache (#7367) · 9379da77
  Hanming Lu authored Jul 13, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  9379da77
11 Jul, 2025 2 commits
- temporarily disable deepep-8-gpu and activate two small tests (#7961) · 475a249b
  Cheng Wan authored Jul 11, 2025
  
  475a249b
- Support Kimi K2 (#7940) · 61555307
  Atream authored Jul 11, 2025
  
  61555307
10 Jul, 2025 3 commits
- Feat: Support Phi-3.5-MoE in SGLang (#7907) · 2d54d4bb
  Binyao Jiang authored Jul 09, 2025
  
  2d54d4bb
- vlm: support video as an input modality (#5888) · b5e3d603
  Mick authored Jul 10, 2025
  
  b5e3d603
- [feature] Add start step profile argument in /start_profile (#7608) · dd445a41
  kyleliang-nv authored Jul 09, 2025
  
  dd445a41
09 Jul, 2025 1 commit
- [CI] Add deepep tests to CI (#7872) · d487555f
  Cheng Wan authored Jul 09, 2025
  
  d487555f
08 Jul, 2025 4 commits
- [Multimodal][Perf] Use `pybase64` instead of `base64` (#7724) · a37e1247
  Brayden Zhong authored Jul 08, 2025
  
  a37e1247
- fix: Handles input_embeds in GenerateReqInput when n>1 (#7830) · 136c6e04
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  136c6e04
- Support Mimo-VL (#7579) · 43e20c06
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  43e20c06
- [Minor] Fix sporadic CI timeout caused by underestimated tests. (#7850) · 2b0e1d1c
  Lifu Huang authored Jul 08, 2025
  
  2b0e1d1c
07 Jul, 2025 1 commit
- Integrate triton moe kernel (#7689) · 253454de
  Yuan Luo authored Jul 07, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  253454de
06 Jul, 2025 1 commit
- [AMD] Add test_fused_moe.py and test_rope_rocm.py to AMD CI (#5246) · e00715eb
  Hubert Lu authored Jul 06, 2025
  
  e00715eb
05 Jul, 2025 3 commits
- Fix CI test OOM issue. (#7799) · 01f98730
  Lifu Huang authored Jul 05, 2025
  
  01f98730
- ci: fix port args (#7792) · 199d6218
  Mick authored Jul 06, 2025
  
  199d6218
- DP Attention with Auto DeepEP Dispatch (#7222) · 8fc910db
  Cheng Wan authored Jul 05, 2025
  
  8fc910db
04 Jul, 2025 2 commits
- Move mem_fraction_static adjustment for multimodal models to `server_args.py`... · 14229ccf
  Lianmin Zheng authored Jul 04, 2025
```
Move mem_fraction_static adjustment for multimodal models to `server_args.py` & Fix session control & Other cleanups (#7748)
```
  14229ccf
- Add V2-lite model test (#7390) · 4de03953
  YanbingJiang authored Jul 04, 2025
```
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  4de03953
03 Jul, 2025 4 commits
- Ascend attention backend(PA&MLA) (#7722) · 1e0e5497
  ronnie_zheng authored Jul 03, 2025
```
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>
```
  1e0e5497
- Support updating weights at once by stopping all requests (#6698) · d3c275b1
  Albert authored Jul 03, 2025
```
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
Co-authored-by: Zilin Zhu <zhuzilinallen@gmail.com>
```
  d3c275b1
- Support non-contiguous query input for extend/decode attention (#7462) · b044400d
  YanbingJiang authored Jul 03, 2025
  
  b044400d
- [RL] support update_weights_from_distributed with different group and multiple weights (#7292) · 0626f678
  Zilin Zhu authored Jul 03, 2025
  
  0626f678
02 Jul, 2025 3 commits
- [AMD] Temporarily disable test_no_overlap_scheduler and test_vision_chunked_prefill (#7717) · b116b21a
  Hubert Lu authored Jul 02, 2025
  
  b116b21a
- [1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641
  AniZpZ authored Jul 02, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>
```
  8e03b641
- Improve error handling for requests with unloaded LoRA path(s) (#7642) · 1a08358a
  Lifu Huang authored Jul 01, 2025
  
  1a08358a
30 Jun, 2025 2 commits
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
- [CPU] add c++ kernel to bind CPU cores and memory node (#7524) · c5131f7a
  Chunyuan WU authored Jun 30, 2025
  
  c5131f7a
29 Jun, 2025 3 commits
- [AMD] Add unit-test-sgl-kernel-amd to AMD CI (#7539) · 3b3f1e3a
  Hubert Lu authored Jun 29, 2025
  
  3b3f1e3a
- Move files related to EPLB (#7580) · 0c9c6c75
  fzyzcjy authored Jun 30, 2025
  
  0c9c6c75
- Fix stream reasoning parser and Adds Kimi reasoning parser (#7432) · 8f335b5b
  Xinyuan Tong authored Jun 29, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8f335b5b
28 Jun, 2025 3 commits
- fix unit tests (#7618) · a8c10aee
  Yineng Zhang authored Jun 28, 2025
  
  a8c10aee
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
27 Jun, 2025 3 commits
- Fix broken CI TestVILAServer (#7610) · d7374d74
  Lifu Huang authored Jun 27, 2025
  
  d7374d74
- Move multimodal processors into a separate folder (#7581) · ce3a3e87
  Lianmin Zheng authored Jun 27, 2025
  
  ce3a3e87
- feat: support compatibility between MTP and two-batch-overlap (#7225) · 41650b0d
  Qiaolin Yu authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  41650b0d