Commits · 059c13de5cba5dd7c56aa6c39dce5a6291abe4c4 · change / sglang · GitLab

15 Sep, 2025 27 commits
- Fix trtllm_moe wrong correction bias (#10440) · 059c13de
  fzyzcjy authored Sep 15, 2025
  
  059c13de
- Run tests based on labels (#10456) · 50dc0c1e
  Lianmin Zheng authored Sep 15, 2025
  
  50dc0c1e
- Add rtx5880 moe triton (#10439) · 76becc1d
  Jimmy_L authored Sep 15, 2025
  
  76becc1d
- [HotFix]: Hot fix import path in 3fs_bench_client.py (#10463) · 2a37b24d
  hzh0425 authored Sep 15, 2025
  
  2a37b24d
- Update GITHUB_TOKEN secret for documentation push (#10458) · f73aae0b
  Lianmin Zheng authored Sep 14, 2025
  
  f73aae0b
- [router] fix logger ordering git ctx (#10457) · 69b35793
  Chang Su authored Sep 14, 2025
  
  69b35793
- [router] add dependency for router (#10401) · 957482c8
  ooapex authored Sep 15, 2025
  
  957482c8
- fix(server_args): Skip chunked_prefill_size validation when disaggregation mode is decode (#10358) · 3795b6a4
  Jimmy authored Sep 15, 2025
  
  3795b6a4
- [router] fix service discovery and mcp ut (#10449) · 7eccbe99
  Simo Lin authored Sep 15, 2025
  
  7eccbe99
- fix: fix max_new_tokens uninitialized error (#9343) · 0549f21c
  Mick authored Sep 15, 2025
  
  0549f21c
- [CI] Fix token key in label-pr.yml workflow (#10452) · b354e3c9
  Lianmin Zheng authored Sep 14, 2025
  
  b354e3c9
- Update permissions in label-pr.yml (#10450) · 65e6f48c
  Lianmin Zheng authored Sep 14, 2025
  
  65e6f48c
- Fix label PR (#10445) · 0ec580a8
  Lianmin Zheng authored Sep 14, 2025
  
  0ec580a8
- Add reasoning examples for GPT-OSS in Markdown examples (#9626) · 0b14159f
  Vincent Zhong authored Sep 14, 2025
  
  0b14159f
- [docs / oneliner] update mmmu docs instruction (#9768) · 1489cd6c
  Vincent Zhong authored Sep 14, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1489cd6c
- metrics: support customer labels specified in request header (#10143) · fc2c3a3d
  Yingchun Lai authored Sep 15, 2025
  
  fc2c3a3d
- Fix label pr for ci (#10441) · 8f6a1758
  Lianmin Zheng authored Sep 14, 2025
  
  8f6a1758
- Tiny fix wrong naming (#10437) · 01018138
  fzyzcjy authored Sep 15, 2025
  
  01018138
- Refactor TopK to ensure readability and extensibility (#9338) · 4844fac9
  Cheng Wan authored Sep 14, 2025
  
  4844fac9
- automatically label pr for ci (#10435) · b7d385e8
  Lianmin Zheng authored Sep 14, 2025
  
  b7d385e8
- [4/N]DP refactor: support watching mode `get_load` and shortest queue strategy (#10201) · 305c9e8c
  Liangsheng Yin authored Sep 15, 2025
  
  305c9e8c
- Revert "Fix FA4 import cause moe_fused_gate output be illegal memory" (#10432) · ca63f075
  fzyzcjy authored Sep 15, 2025
  
  ca63f075
- [router]: Add Embedding routing logic (#10129) · f9ee6ae1
  Jintao Zhang authored Sep 15, 2025
```
Signed-off-by: Jintao Zhang <zhangjintao9020@gmail.com>
Co-authored-by: Waël Boukhobza <wawa_wael@live.fr>
```
  f9ee6ae1
- feat: add dsv3 fp4 cutlass moe etp ut (#10433) · dcee42c2
  Yineng Zhang authored Sep 14, 2025
  
  dcee42c2
- Fix correction bias undefined behavior for nvfp4 models (#10426) · 258d02c8
  fzyzcjy authored Sep 15, 2025
  
  258d02c8
- Add split tile size for Triton attention (#10425) · 60d7beda
  Ke Bao authored Sep 15, 2025
  
  60d7beda
- [Fix] MoE: fix w8a8_fp8 MoE and add tests to cover this code path (#10429) · 2f8ba6fe
  Cheng Wan authored Sep 14, 2025
  
  2f8ba6fe
14 Sep, 2025 13 commits
- fix: enable cu124 and cu128 build on main push (#10431) · 7ce6c10e
  Yineng Zhang authored Sep 14, 2025
  
  7ce6c10e
- fix: use latest flashinfer (#10428) · 55025b92
  Yineng Zhang authored Sep 14, 2025
  
  55025b92
- [Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 1 (#9962) · 4c21b090
  Feng Su authored Sep 15, 2025
```
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
Signed-off-by: Huaixin Chang <changhuaixin@linux.alibaba.com>
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>
```
  4c21b090
- Typo: in `--enable-custom-logit-processor`: agree with cli arg (#10076) · 165abeeb
  艾力可 authored Sep 14, 2025
  
  165abeeb
- [PD metrics] Fix some uncompleted PD related metrics (#8627) · 21ca4c3a
  Yingchun Lai authored Sep 14, 2025
  
  21ca4c3a
- Fix sgl-kernel + srt CI (#10419) · e3cf812f
  fzyzcjy authored Sep 14, 2025
  
  e3cf812f
- Support profile args in Engine API (#6539) · 4da55336
  fzyzcjy authored Sep 14, 2025
  
  4da55336
- Support global scale in addition to per expert scale for cutedsl moe (#10270) · ac964d2e
  fzyzcjy authored Sep 14, 2025
  
  ac964d2e
- Support offloading in fp8 (#9948) · fa46e2bd
  fzyzcjy authored Sep 14, 2025
  
  fa46e2bd
- [2/2] Speed up prefill mla attention concat (#10157) · b047b553
  fzyzcjy authored Sep 14, 2025
  
  b047b553
- Let sgl-kernel changes be tested on srt (#10313) · a0f844ed
  fzyzcjy authored Sep 14, 2025
  
  a0f844ed
- Fix the global scale fix does not support EPLB and improve enabling condition (#10369) · 2df532ef
  fzyzcjy authored Sep 14, 2025
  
  2df532ef
- Auto determine sgl kernel version in blackwell CI (#10318) · abea9250
  fzyzcjy authored Sep 14, 2025
  
  abea9250