Commits · 2d54d4bb648dea1bcb13af2ddab30fcf4e1fa37f · change / sglang · GitLab

10 Jul, 2025 3 commits
- Feat: Support Phi-3.5-MoE in SGLang (#7907) · 2d54d4bb
  Binyao Jiang authored Jul 09, 2025
  
  2d54d4bb
- vlm: support video as an input modality (#5888) · b5e3d603
  Mick authored Jul 10, 2025
  
  b5e3d603
- [feature] Add start step profile argument in /start_profile (#7608) · dd445a41
  kyleliang-nv authored Jul 09, 2025
  
  dd445a41
09 Jul, 2025 1 commit
- [CI] Add deepep tests to CI (#7872) · d487555f
  Cheng Wan authored Jul 09, 2025
  
  d487555f
08 Jul, 2025 4 commits
- [Multimodal][Perf] Use `pybase64` instead of `base64` (#7724) · a37e1247
  Brayden Zhong authored Jul 08, 2025
  
  a37e1247
- fix: Handles input_embeds in GenerateReqInput when n>1 (#7830) · 136c6e04
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  136c6e04
- Support Mimo-VL (#7579) · 43e20c06
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  43e20c06
- [Minor] Fix sporadic CI timeout caused by underestimated tests. (#7850) · 2b0e1d1c
  Lifu Huang authored Jul 08, 2025
  
  2b0e1d1c
07 Jul, 2025 1 commit
- Integrate triton moe kernel (#7689) · 253454de
  Yuan Luo authored Jul 07, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  253454de
06 Jul, 2025 1 commit
- [AMD] Add test_fused_moe.py and test_rope_rocm.py to AMD CI (#5246) · e00715eb
  Hubert Lu authored Jul 06, 2025
  
  e00715eb
05 Jul, 2025 3 commits
- Fix CI test OOM issue. (#7799) · 01f98730
  Lifu Huang authored Jul 05, 2025
  
  01f98730
- ci: fix port args (#7792) · 199d6218
  Mick authored Jul 06, 2025
  
  199d6218
- DP Attention with Auto DeepEP Dispatch (#7222) · 8fc910db
  Cheng Wan authored Jul 05, 2025
  
  8fc910db
04 Jul, 2025 2 commits
- Move mem_fraction_static adjustment for multimodal models to `server_args.py`... · 14229ccf
  Lianmin Zheng authored Jul 04, 2025
```
Move mem_fraction_static adjustment for multimodal models to `server_args.py` & Fix session control & Other cleanups (#7748)
```
  14229ccf
- Add V2-lite model test (#7390) · 4de03953
  YanbingJiang authored Jul 04, 2025
```
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  4de03953
03 Jul, 2025 4 commits
- Ascend attention backend(PA&MLA) (#7722) · 1e0e5497
  ronnie_zheng authored Jul 03, 2025
```
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>
```
  1e0e5497
- Support updating weights at once by stopping all requests (#6698) · d3c275b1
  Albert authored Jul 03, 2025
```
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
Co-authored-by: Zilin Zhu <zhuzilinallen@gmail.com>
```
  d3c275b1
- Support non-contiguous query input for extend/decode attention (#7462) · b044400d
  YanbingJiang authored Jul 03, 2025
  
  b044400d
- [RL] support update_weights_from_distributed with different group and multiple weights (#7292) · 0626f678
  Zilin Zhu authored Jul 03, 2025
  
  0626f678
02 Jul, 2025 3 commits
- [AMD] Temporarily disable test_no_overlap_scheduler and test_vision_chunked_prefill (#7717) · b116b21a
  Hubert Lu authored Jul 02, 2025
  
  b116b21a
- [1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641
  AniZpZ authored Jul 02, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>
```
  8e03b641
- Improve error handling for requests with unloaded LoRA path(s) (#7642) · 1a08358a
  Lifu Huang authored Jul 01, 2025
  
  1a08358a
30 Jun, 2025 2 commits
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
- [CPU] add c++ kernel to bind CPU cores and memory node (#7524) · c5131f7a
  Chunyuan WU authored Jun 30, 2025
  
  c5131f7a
29 Jun, 2025 3 commits
- [AMD] Add unit-test-sgl-kernel-amd to AMD CI (#7539) · 3b3f1e3a
  Hubert Lu authored Jun 29, 2025
  
  3b3f1e3a
- Move files related to EPLB (#7580) · 0c9c6c75
  fzyzcjy authored Jun 30, 2025
  
  0c9c6c75
- Fix stream reasoning parser and Adds Kimi reasoning parser (#7432) · 8f335b5b
  Xinyuan Tong authored Jun 29, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8f335b5b
28 Jun, 2025 3 commits
- fix unit tests (#7618) · a8c10aee
  Yineng Zhang authored Jun 28, 2025
  
  a8c10aee
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
27 Jun, 2025 4 commits
- Fix broken CI TestVILAServer (#7610) · d7374d74
  Lifu Huang authored Jun 27, 2025
  
  d7374d74
- Move multimodal processors into a separate folder (#7581) · ce3a3e87
  Lianmin Zheng authored Jun 27, 2025
  
  ce3a3e87
- feat: support compatibility between MTP and two-batch-overlap (#7225) · 41650b0d
  Qiaolin Yu authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  41650b0d
- Add e2e test for multi instance multi stage memory release/resume occupuation (#7208) · 031f64aa
  Ata Fatahi authored Jun 26, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  031f64aa
26 Jun, 2025 1 commit
- Update seed in CPU UTs to avoid flaky failure with single test (#7544) · 0e05fe8c
  YanbingJiang authored Jun 26, 2025
  
  0e05fe8c
25 Jun, 2025 4 commits
- Fix FP8 KV Cache Support in FA3 Backend (#7148) · a1c1ebe9
  Yuhong Guo authored Jun 25, 2025
  
  a1c1ebe9
- feat: send kvmetrics from sglang scheduler (#6721) · f3cbd245
  zixuanzhang226 authored Jun 25, 2025
  
  f3cbd245
- [CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel... · 7eb47b0f
  Chunyuan WU authored Jun 25, 2025
```
[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  7eb47b0f
- misc: Improvement to serving_chat.py and add more ut (#7489) · 112b496a
  Chang Su authored Jun 24, 2025
  
  112b496a
23 Jun, 2025 1 commit
- ci: Revert openai_server related tests in AMD suites (#7449) · fa42e419
  Chang Su authored Jun 23, 2025
  
  fa42e419