Commits · 2cf3d0f89f7760f2d507099c45da1a3a34472ec7 · change / sglang

"docs/vscode:/vscode.git/clone" did not exist on "efc52f85e2d5c9b31545d4092f2b361b6ff04d67"

30 Oct, 2025 24 commits
- [router] use safety_identifier replace user on chat history storage (#12185) · 2cf3d0f8
  rongfu.leng authored Oct 30, 2025
  
  2cf3d0f8
- feat: add EP support in tuning (#12012) · 1ed1abfd
  Chen1022 authored Oct 30, 2025
  
  1ed1abfd
- [docker] clean up main dockerfile for router and dev configurations (#12364) · ecb9fa14
  Chang Su authored Oct 30, 2025
```
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  ecb9fa14
- [router] harmony responses api streaming support (#12395) · 700daa34
  Simo Lin authored Oct 30, 2025
  
  700daa34
- [sgl-kernel] upd deepgemm hash to rebased commit (#11960) · 39cee0fe
  Fan Yin authored Oct 30, 2025
  
  39cee0fe
- Revert "Triton fused_moe_kernel support ep moe tuning" (#12377) · 04e5b6fa
  Xiaoyu Zhang authored Oct 30, 2025
  
  04e5b6fa
- [Feature] Support DeepSeek MTP on NPU (#11897) · ce6b17c0
  Even Zhou authored Oct 30, 2025
```
Co-authored-by: liupeng374 <liupeng374@huawei.com>
```
  ce6b17c0
- [NPU] bugfix for Qwen3-Next and performance update (#11969) · cafebef1
  Even Zhou authored Oct 30, 2025
  
  cafebef1
- [Test] Enhance radix cache test for spec cases (#12394) · 73dfd2df
  Liangsheng Yin authored Oct 30, 2025
  
  73dfd2df
- Enable fast silu-and-mul-and-quant fused kernel (#11806) · df5192cf
  fzyzcjy authored Oct 30, 2025
  
  df5192cf
- [Feature] Initial eagle3 support for Deepseek-like models (#12319) · 78c43d88
  JensenFire authored Oct 30, 2025
  
  78c43d88
- Fix DeepSeek chat templates to handle tool call arguments type checking (#11700) (#12123) · 7e28c67d
  Kangyan-Zhou authored Oct 30, 2025
  
  7e28c67d
- [fix] added image token as prefix for deepseek-ocr (#12358) · 3edba9bc
  Tanjiro authored Oct 30, 2025
  
  3edba9bc
- [Bug fix][PP] fix deadlock with tie_word_embeddings (#12362) · e5ec9764
  Xuchun Shang authored Oct 30, 2025
```
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
```
  e5ec9764
- Import flash_mla from sgl-kernel (#12135) · 621dfb88
  Baizhou Zhang authored Oct 29, 2025
  
  621dfb88
- Super tiny fix AMD ci (#12378) · fb52d35f
  fzyzcjy authored Oct 30, 2025
  
  fb52d35f
- Allow benchmarking tool to handle empty response (#12174) · 2b71531a
  Kangyan-Zhou authored Oct 29, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  2b71531a
- Super tiny add tag for benchmark scripts (#12340) · 25c50498
  fzyzcjy authored Oct 30, 2025
  
  25c50498
- [NPU] fix pp_size>1 (#12195) · 8e2ac2e6
  Makcum888e authored Oct 30, 2025
  
  8e2ac2e6
- [Perf] Optimize multimodal mm_inputs process in scheduler (#11910) · 17a57fd8
  Yuan Luo authored Oct 30, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  17a57fd8
- [Ckpt Engine] feat: new sglang entrypoint support for update (#12216) · 32438eba
  Teng Ma authored Oct 30, 2025
  
  32438eba
- [bugfix] fix deepseekvl2 and deepseek_ocr model type conflict (#12050) · fed02a49
  FlyPanda authored Oct 30, 2025
```
Co-authored-by: herta <herta@pplabs.org>
```
  fed02a49
- [router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153) · 03b3e89a
  Simo Lin authored Oct 29, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  03b3e89a
- Fuse wk and weight_proj in Indexer for DeepSeekV3.2-FP4 (#12094) · 9ff9fa7f
  Trevor Morris authored Oct 29, 2025
  
  9ff9fa7f
29 Oct, 2025 16 commits
- [CI] Add Llama 3.1 8B FP4 to B200 CI (#12182) · 7ed8ba05
  b8zhong authored Oct 29, 2025
  
  7ed8ba05
- Fix Duplicate Classmethod in spec_info.py (#12354) · df08f346
  Stefan He authored Oct 29, 2025
  
  df08f346
- [router] update router docker to use maturin and build from local (#12350) · db15148c
  Chang Su authored Oct 29, 2025
  
  db15148c
- [bug] fix router installation to include additional dependency (#12348) · 5259becd
  Simo Lin authored Oct 29, 2025
  
  5259becd
- support cutlass fp4 kernel in sm120 (#11737) · ed1044ac
  AichenF authored Oct 30, 2025
  
  ed1044ac
- [router] refactor mcp to use LRU and fix pooling bug (#12346) · d717e73e
  Chang Su authored Oct 29, 2025
  
  d717e73e
- Fix Flashinfer Backend for SM120 Usage (#12325) · a1816187
  weiliang authored Oct 30, 2025
  
  a1816187
- [2/2] Deepseek deterministic: support deepseek v3 deterministic inference on 8 x H200 (#12095) · e39628fd
  Minglei Zhu authored Oct 29, 2025
  
  e39628fd
- fix: llama 4 + trtllm gen + fp8 kv cache incompatibility (#12347) · bacb3825
  b8zhong authored Oct 29, 2025
  
  bacb3825
- [bug] fix router pypi license file (#12345) · b53d9e11
  Simo Lin authored Oct 29, 2025
  
  b53d9e11
- [Fix] fix type issue of env flag value MODELOPT_MAX_TOKENS_PER_EXPERT (#11709) · 8a683821
  zejunchen-zejun authored Oct 30, 2025
```
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>
```
  8a683821
- Triton fused_moe_kernel support ep moe tuning (#12343) · 52694b60
  Xiaoyu Zhang authored Oct 29, 2025
  
  52694b60
- [router] fix router release workflow and add build test in PR (#12315) · 400bddf2
  Chang Su authored Oct 29, 2025
  
  400bddf2
- [Bug fix] trace: fix import error in mini_lb if sgl-router image does not install sglang (#12338) · 1e90fe2e
  Feng Su authored Oct 29, 2025
  
  1e90fe2e
- feat: return partial generation results when aborting requests in waiting queue (#11673) · caa5d296
  Yuhong Guo authored Oct 29, 2025
  
  caa5d296
- Eagle3 DP attention for Qwen3 MoE (#12002) · 750940ae
  Rain H authored Oct 29, 2025
  
  750940ae