Commits · 4da5533682232d67e8aeb9cd933599d272cf352a · change / sglang · GitLab

14 Sep, 2025 13 commits
- Support profile args in Engine API (#6539) · 4da55336
  fzyzcjy authored Sep 14, 2025
  
  4da55336
- Support global scale in addition to per expert scale for cutedsl moe (#10270) · ac964d2e
  fzyzcjy authored Sep 14, 2025
  
  ac964d2e
- Support offloading in fp8 (#9948) · fa46e2bd
  fzyzcjy authored Sep 14, 2025
  
  fa46e2bd
- [2/2] Speed up prefill mla attention concat (#10157) · b047b553
  fzyzcjy authored Sep 14, 2025
  
  b047b553
- Let sgl-kernel changes be tested on srt (#10313) · a0f844ed
  fzyzcjy authored Sep 14, 2025
  
  a0f844ed
- Fix the global scale fix does not support EPLB and improve enabling condition (#10369) · 2df532ef
  fzyzcjy authored Sep 14, 2025
  
  2df532ef
- Auto determine sgl kernel version in blackwell CI (#10318) · abea9250
  fzyzcjy authored Sep 14, 2025
  
  abea9250
- Add h200 fused moe config for Qwen3-Next (#10404) · b3c97762
  Ximingwang-09 authored Sep 14, 2025
```
Co-authored-by: 纬杭 <ximing.wxm@antgroup.com>
```
  b3c97762
- Add self.capture_aux_hidden_states For GLM-4.5V (#10228) · b8347b40
  Yuxuan Zhang authored Sep 14, 2025
  
  b8347b40
- Fix cutlass moe accuracy drop caused by attention UB from DP padding mode (#10414) · 72dfa96a
  fzyzcjy authored Sep 14, 2025
  
  72dfa96a
- fix duplicated logger in eager_utils (#10410) · 05b01ef4
  lijin23 authored Sep 14, 2025
  
  05b01ef4
- [Hack] Add pd-disaggregation decode polling interval (#10411) · 55a6e644
  Liangsheng Yin authored Sep 14, 2025
  
  55a6e644
- Remove repeatedly lists adding in `init_incremental_detokenization` (#10412) · 6897e06b
  Liangsheng Yin authored Sep 14, 2025
  
  6897e06b
13 Sep, 2025 10 commits
- [Generative Score API] Scoring(Prefill-only) optimizations. (#9748) · a360511d
  Sundara Raman Ramachandran authored Sep 13, 2025
  
  a360511d
- [Performance] Dynamic Batch Tokenizer (#9382) · 94d0f656
  Sundara Raman Ramachandran authored Sep 13, 2025
  
  94d0f656
- Update ROCm docker image to add sgl-router support (#10406) · eca59f96
  kk authored Sep 14, 2025
```
Co-authored-by: Colin Wang <kangwang@amd.com>
```
  eca59f96
- [Fix] Support qwen3-next MTP+DP (#10392) · 97528610
  Binyao Jiang authored Sep 13, 2025
  
  97528610
- support qwen3_next blackwell (#10403) · 297d3745
  Yi Zhang authored Sep 13, 2025
  
  297d3745
- [Fix] Init mamba related memory pools with torch.zeros (#10400) · 31e9d3a5
  Binyao Jiang authored Sep 12, 2025
  
  31e9d3a5
- fix: tool parse in large streaming chunk beginning with normal content (#10397) · 6f4676ef
  Xinyuan Tong authored Sep 12, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6f4676ef
- Fix the style of sgl kernel (#10398) · c9ec4cae
  Lianmin Zheng authored Sep 12, 2025
  
  c9ec4cae
- fix probs name which without temp scaling name (#9984) · 99757cc3
  narutolhy authored Sep 12, 2025
  
  99757cc3
- [Auto Sync] Update xgrammar_backend.py (20250913) (#10395) · cdddab05
  Lianmin Zheng authored Sep 12, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  cdddab05
12 Sep, 2025 17 commits
- [router] add not implemented functions for multi model trait (#10394) · 7c5a0a1b
  Simo Lin authored Sep 12, 2025
  
  7c5a0a1b
- [HiCache] doc: update deployment in readme (#10332) · 49f169d5
  Teng Ma authored Sep 13, 2025
```
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
```
  49f169d5
- [HiCache] fix mooncake config in different tp size (#10377) · 7fce2fd9
  Teng Ma authored Sep 13, 2025
  
  7fce2fd9
- Support Qwen3-Next on Ascend NPU (#10379) · 16cd550c
  Even Zhou authored Sep 13, 2025
  
  16cd550c
- Benchmark: Support API_KEY without 'bearer' (#10380) · d5e2a374
  Muqi Li authored Sep 13, 2025
  
  d5e2a374
- [router] Add get and cancel method for response api (#10387) · 366043db
  Keyang Ru authored Sep 12, 2025
  
  366043db
- [router] allow one router to support different model families and serving mode (#10244) · 2f173ea0
  Simo Lin authored Sep 12, 2025
  
  2f173ea0
- Add sentencepiece to project dependencies (#10386) · 321fecab
  Mohammad Miadh Angkad authored Sep 13, 2025
  
  321fecab
- feat: add deepseek v3 fp4 ut (#10391) · 9d775b1a
  Yineng Zhang authored Sep 12, 2025
  
  9d775b1a
- Fix GPU fault issue when run dsv3 with dp mode and enable torch-compile (#10361) · 78b7465c
  kk authored Sep 13, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  78b7465c
- [bug] fix router ci syntax error (#10390) · 07bcad7f
  Simo Lin authored Sep 12, 2025
  
  07bcad7f
- fix: exclude protobuf generated code (#10388) · 98adac8e
  Yineng Zhang authored Sep 12, 2025
  
  98adac8e
- fix: resolve gb200 image link (#10343) · cef11e9a
  Yineng Zhang authored Sep 12, 2025
  
  cef11e9a
- [Auto Sync] Update base_grammar_backend.py, llguidance_back... (20250911) (#10333) · 2269cf1e
  Lianmin Zheng authored Sep 12, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  2269cf1e
- fix: add fast path for function call (#9023) · 151e287d
  Yi Zhang authored Sep 13, 2025
```
Co-authored-by: tazjin <mail@tazj.in>
```
  151e287d
- [router] enable sccache in ci and local build (#10099) · 8c86595c
  Simo Lin authored Sep 12, 2025
  
  8c86595c
- [router] Add Rerank Routing Logic in Regular Router (#10219) · 4634fd59
  Frank Fang authored Sep 13, 2025
  
  4634fd59