Commits · 78b7465cad01f97653a1384960e908c1bc9cfe0b · change / sglang

"examples/vscode:/vscode.git/clone" did not exist on "08265515b3d80e0172637328abeef79c8819adc0"

12 Sep, 2025 29 commits
- Fix GPU fault issue when run dsv3 with dp mode and enable torch-compile (#10361) · 78b7465c
  kk authored Sep 13, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  78b7465c
- [bug] fix router ci syntax error (#10390) · 07bcad7f
  Simo Lin authored Sep 12, 2025
  
  07bcad7f
- fix: exclude protobuf generated code (#10388) · 98adac8e
  Yineng Zhang authored Sep 12, 2025
  
  98adac8e
- fix: resolve gb200 image link (#10343) · cef11e9a
  Yineng Zhang authored Sep 12, 2025
  
  cef11e9a
- [Auto Sync] Update base_grammar_backend.py, llguidance_back... (20250911) (#10333) · 2269cf1e
  Lianmin Zheng authored Sep 12, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  2269cf1e
- fix: add fast path for function call (#9023) · 151e287d
  Yi Zhang authored Sep 13, 2025
```
Co-authored-by: tazjin <mail@tazj.in>
```
  151e287d
- [router] enable sccache in ci and local build (#10099) · 8c86595c
  Simo Lin authored Sep 12, 2025
  
  8c86595c
- [router] Add Rerank Routing Logic in Regular Router (#10219) · 4634fd59
  Frank Fang authored Sep 13, 2025
  
  4634fd59
- Fix global input scale incompatible with CuTe DSL moe (#10370) · efedbe6c
  fzyzcjy authored Sep 12, 2025
  
  efedbe6c
- Fix FA4 import cause moe_fused_gate output be illegal memory (#10368) · 3a77c80b
  fzyzcjy authored Sep 12, 2025
  
  3a77c80b
- Fix chunked prefix cache for nvfp4 (#10180) · 36acd2ff
  Shu Wang authored Sep 12, 2025
```
Co-authored-by: Elfie Guo <elfieg@nvidia.com>
```
  36acd2ff
- add qwen3-next ut (#10355) · fe6cdf89
  Yi Zhang authored Sep 12, 2025
  
  fe6cdf89
- Support loading weights from remote instance (#8215) · 30d20ce8
  amysaq2023 authored Sep 12, 2025
```
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
Co-authored-by: Chayenne <74843776+zhaochenyang20@users.noreply.github.com>
```
  30d20ce8
- model: support dots.vlm1 model (#8778) · 1b1701f1
  chenge@xiaohongshu.com authored Sep 12, 2025
```
Co-authored-by: weishi <bushou@xiaohongshu.com>
Co-authored-by: Ezra-Yu <1105212286@qq.com>
Co-authored-by: Jianfei Wang <905787410@qq.com>
Co-authored-by: qianwu <wangjianfei@xiaohongshu.com>
```
  1b1701f1
- Revert add mainprocess's proctitle (#10351) · 6d403089
  ybyang authored Sep 12, 2025
  
  6d403089
- Fix Bailing MoE model bugs (#10362) · 24dc2bee
  Yuan Luo authored Sep 12, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
```
  24dc2bee
- Support LingV2 model (#10359) · fac07c9b
  strgrb authored Sep 12, 2025
```
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: guoyuhong <yuhong.gyh@antgroup.com>
```
  fac07c9b
- fix: resolve transfer_kv_all_layer_direct_lf_pf import error (#10360) · b3839a7f
  Yineng Zhang authored Sep 11, 2025
  
  b3839a7f
- fix the break in FlashInferFusedMoE (#10356) · 4aa39d72
  chenqianfzh authored Sep 11, 2025
```
Co-authored-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
```
  4aa39d72
- support memory_pool_host page first direct layout (#10031) · b4c2c421
  huangtingwei authored Sep 12, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  b4c2c421
- Implement Standalone gRPC Server for SGLang Python Scheduler (#10283) · 53ca1552
  Chang Su authored Sep 11, 2025
  
  53ca1552
- [router] Basic OAI Response api (#10346) · a23bdeaf
  Keyang Ru authored Sep 11, 2025
  
  a23bdeaf
- fix dual stream bug (#10352) · 27778010
  Yi Zhang authored Sep 12, 2025
  
  27778010
- model: support Apertus (#9774) · 46d8fb1c
  EduardDurech authored Sep 12, 2025
  
  46d8fb1c
- fix: flashinfer_cutlass_moe: Use max of global expert scales instead of local... · c7e85f53
  Trevor Morris authored Sep 11, 2025
```
fix: flashinfer_cutlass_moe: Use max of global expert scales instead of local for input scale (#10296)
```
  c7e85f53
- [NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#9199) · 3df05f4d
  Shu Wang authored Sep 11, 2025
  
  3df05f4d
- [router][ci] Add gpu utilization analyze with nvml (#10345) · 7b141f81
  Keyang Ru authored Sep 11, 2025
  
  7b141f81
- [CPU][doc] add torch.compile param in example commands (#10349) · 7bc5fb0d
  Zaili Wang authored Sep 12, 2025
  
  7bc5fb0d
- [Auto Sync] Update server_args.py (20250912) (#10347) · 144ee5f3
  Lianmin Zheng authored Sep 11, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  144ee5f3
11 Sep, 2025 11 commits
- chore: bump v0.5.2 (#10221) · b0d25e72
  Yineng Zhang authored Sep 11, 2025
  
  b0d25e72
- add try catch for quant config hf download (#10340) · a2424068
  gongwei-130 authored Sep 11, 2025
  
  a2424068
- [LongCat] Optimize zero_experts_compute_triton by changing mask (#10303) · c5d2b01c
  zk-lover authored Sep 12, 2025
  
  c5d2b01c
- update GLM nightly test threshold (#10331) · 46ccbed2
  Minglei Zhu authored Sep 11, 2025
  
  46ccbed2
- Fix errors of hicache kernels in sgl-kernel for ROCm (#10339) · fe68c148
  Hubert Lu authored Sep 11, 2025
  
  fe68c148
- fix: trtllm-gen attention take zero-init workspace (#10330) · 70c0c1f9
  eigen authored Sep 11, 2025
  
  70c0c1f9
- add qwen3-next doc (#10327) · 760b788a
  Yi Zhang authored Sep 12, 2025
  
  760b788a
- [router][ci] add gpu process check and free port before start server (#10338) · 1ee11df8
  Keyang Ru authored Sep 11, 2025
  
  1ee11df8
- [router] Add OpenAI backend support - core function (#10254) · dee197e1
  Keyang Ru authored Sep 11, 2025
  
  dee197e1
- add h20 qwen3 next config (#10264) · ab795ae8
  Yi Zhang authored Sep 12, 2025
```
Co-authored-by: cao1zhg <114661107+cao1zhg@users.noreply.github.com>
```
  ab795ae8
- [router] add benchmark for regular router and pd router (#10280) · 480d1b8b
  Keyang Ru authored Sep 11, 2025
  
  480d1b8b