Commits · b1bb8e7490d19b02ae7391cf8162fd4ce0976867 · change / sglang · GitLab

22 Sep, 2025 24 commits
- Enables TRT-LLM backend to be used for target_verify (#10281) · b1bb8e74
  pranavm-nvidia authored Sep 22, 2025
```
Co-authored-by: Pranav Marathe <pranavm@ipp1-3309.ipp1a1.colossus.nvidia.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
```
  b1bb8e74
- Fix multimodal registry and code sync scripts (#10759) · 38c00ed7
  Lianmin Zheng authored Sep 22, 2025
```
Co-authored-by: cctry <shiyang@x.ai>
```
  38c00ed7
- refactor zero copy (#10300) · d4041a5e
  pansicheng authored Sep 23, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  d4041a5e
- [Generative Score API] Added test_scores_api.py to github CICD to run per commit (#10755) · 2f555c4c
  Vedant Jhaveri authored Sep 22, 2025
```
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
```
  2f555c4c
- chore: bump sgl-kernel v0.3.12 (#10732) · e53df7c0
  Yineng Zhang authored Sep 22, 2025
  
  e53df7c0
- Fix MTP MoE weight loading with NVFP4 target model. (#10758) · 9c53dad8
  Jue WANG authored Sep 22, 2025
  
  9c53dad8
- [router] update ci so only execute benchmarks when labels are added (#10757) · 7ca1bea6
  Simo Lin authored Sep 22, 2025
  
  7ca1bea6
- [router] refactor router and worker management 3/n (#10727) · 97c38239
  Simo Lin authored Sep 22, 2025
  
  97c38239
- bugfix: Fix `get_worker_urls_for_model` in http/router.rs (#10754) · 60dbbd08
  Chang Su authored Sep 22, 2025
  
  60dbbd08
- Add warnings and remove dependency for deterministic inference (#10724) · aa1c5cf5
  Baizhou Zhang authored Sep 22, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  aa1c5cf5
- [Docs, minor] Fix LLM doc matrix (#10753) · 592caab6
  Adarsh Shirawalmath authored Sep 22, 2025
  
  592caab6
- Fix CI TestChunkedSGMV (#10737) · 2101d93b
  Lifu Huang authored Sep 22, 2025
  
  2101d93b
- Fix flaky logprobs test (#10728) · 70e4b218
  Shangming Cai authored Sep 22, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  70e4b218
- fix capture_bs when speculative decoding enabled (#10730) · 944f1ea0
  feng397 authored Sep 22, 2025
  
  944f1ea0
- EPLB: prefer to use physical experts in the same node (#9849) · 9d7e82a0
  Yingchun Lai authored Sep 22, 2025
  
  9d7e82a0
- Convert FLASHINFER_WORKSPACE_SIZE to integer (#10731) · f0580551
  Yang Yu authored Sep 22, 2025
  
  f0580551
- [4/4] Introduce CachedKernel to reduce CSGMV kernel launch overheads by 60% (#10709) · 635ccda6
  Lifu Huang authored Sep 21, 2025
  
  635ccda6
- [Ascend] codeowner updates for ascend related files (#10699) · 1c3dbad8
  ronnie_zheng authored Sep 22, 2025
  
  1c3dbad8
- [2/2] Support deterministic inference for temperature > 0 (#10678) · e2ac7888
  Qiaolin Yu authored Sep 21, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
```
  e2ac7888
- [deterministic inference] Move batch invariant pkg to sglang (#10695) · 86527a47
  Stefan He authored Sep 21, 2025
  
  86527a47
- Support deterministic inference with triton backend (#10694) · 134b4f7e
  Ethan (Yusheng) Su authored Sep 21, 2025
  
  134b4f7e
- [Auto Sync] Update deepseek_v2.py (20250922) (#10717) · f67d1f45
  Yineng Zhang authored Sep 21, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Michael Granado <mgranado@together.ai>
```
  f67d1f45
- Optimize cutlass int8 gemm kernel for large M on SM89 Ada GPU (#10714) · 0f04a5f4
  Qi Yuhang authored Sep 22, 2025
  
  0f04a5f4
- fix: disable gpt-oss b200 ut (#10716) · 2f18602f
  Yineng Zhang authored Sep 21, 2025
  
  2f18602f
21 Sep, 2025 7 commits
- [Router]fix: fix get_load missing api_key (#10385) · 56321e9f
  Jimmy authored Sep 22, 2025
  
  56321e9f
- Refactors radix cache for extra key support (#10317) · 12d6cf18
  Xinyuan Tong authored Sep 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  12d6cf18
- Update release-docs.yml (#10706) · fc3e5420
  sglang-bot authored Sep 21, 2025
  
  fc3e5420
- [3/4] Speed up CSGMV backend perf by 10% through dynamic chunking + kernel optimization (#10592) · 08ecd0aa
  Lifu Huang authored Sep 20, 2025
  
  08ecd0aa
- Super tiny fix extra logs (#10697) · 720c1c8c
  fzyzcjy authored Sep 21, 2025
  
  720c1c8c
- feat: update server args (#10696) · d403c143
  Yineng Zhang authored Sep 20, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  d403c143
- [Feature] Support deterministic inference with FA3 backend (#10651) · cba0d8c3
  Stefan He authored Sep 20, 2025
  
  cba0d8c3
20 Sep, 2025 9 commits
- [Auto Sync] Update modelopt_quant.py (20250920) (#10688) · f1d78923
  Yineng Zhang authored Sep 20, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  f1d78923
- fix: remove awq_dequantize deps (#10686) · 7c876de7
  Yineng Zhang authored Sep 20, 2025
  
  7c876de7
- fix: update run_suite (#10685) · ba94b829
  Yineng Zhang authored Sep 20, 2025
  
  ba94b829
- fix(disagg): fix sending KV cache in case of MLA for NIXL backend (#10673) · 2b7417bf
  dmitrygx authored Sep 20, 2025
  
  2b7417bf
- Replace os.environ in layernorm.py (#10684) · f1116495
  Baizhou Zhang authored Sep 20, 2025
  
  f1116495
- [Performance] Qwen3-Next: optimize causal_conv1d_fn triton kernel - up to 9% faster (#10680) · bd7eb020
  Binyao Jiang authored Sep 20, 2025
  
  bd7eb020
- chore: upgrade mooncake 0.3.6.post1 to fix gb200 dockerfile (#10681) · 74cd6e39
  Shangming Cai authored Sep 20, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  74cd6e39
- [Auto Sync] Update deepseek_v2.py (20250920) (#10683) · b17e67df
  Yineng Zhang authored Sep 19, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  b17e67df
- [1/2] Support deterministic inference with flashinfer attention backend (#10645) · 8ecef73f
  Baizhou Zhang authored Sep 19, 2025
```
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  8ecef73f