Commits · 9c339d6b473b236018aa1ca87fbc0df0d1e43ec0 · change / sglang · GitLab

27 Sep, 2025 12 commits
- [PD] Extract the PP transfer layer calculate logic from Mooncake to Common backend (#10565) · 9c339d6b
  Shangming Cai authored Sep 28, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  9c339d6b
- Add support for topk metadata transferring for PD (#10616) · e23e280e
  Shangming Cai authored Sep 28, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  e23e280e
- Add auth to get server info (#10751) · 51f7c6bd
  Muqi Li authored Sep 27, 2025
```
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  51f7c6bd
- fix: make inference deterministic for large TP (#10930) · 62e2e99d
  Xinyuan Tong authored Sep 27, 2025
```
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  62e2e99d
- [Fix] RuntimeError: get_cfg Unsupported input_type:Float4_e2m1fn_x2 in using... · 8ebf72fe
  kk authored Sep 27, 2025
```
[Fix] RuntimeError: get_cfg Unsupported input_type:Float4_e2m1fn_x2 in using aiter-mxfp4-moe (#10981)
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  8ebf72fe
- fix: fp8 quantization failure of qwen 2.5 VL 7B model (#10112) · 82605747
  Yueyang Pan authored Sep 27, 2025
```
Signed-off-by: PanJason <pyyjason@gmail.com>
```
  82605747
- [router][grpc] Support E2E non-stream chat completions (#10980) · 37f3325b
  Chang Su authored Sep 26, 2025
  
  37f3325b
- [Bugfix][Minor][Benchmark] Fix some bugs due to PR #10495 (#10982) · bd95944c
  Muqi Li authored Sep 27, 2025
  
  bd95944c
- [HiCache]: Support dynamic loading backends for hicache (#10551) · c8a5d12a
  hzh0425 authored Sep 27, 2025
```
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
```
  c8a5d12a
- Ci monitor support performance (#10965) · 2387c22b
  Xiaoyu Zhang authored Sep 27, 2025
  
  2387c22b
- Add simple docker file for B300 (#10944) · 592ddf37
  hlu1 authored Sep 26, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  592ddf37
- [router][grpc] Add helpfer functions for decoder in router.rs and fix specs (#10971) · 0c3db889
  Chang Su authored Sep 26, 2025
  
  0c3db889
26 Sep, 2025 24 commits
- refactor loading weights from remote instance coding format (#10941) · 2bdaf482
  amysaq2023 authored Sep 27, 2025
```
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
```
  2bdaf482
- ci: refactor nightly test (#10495) · 777eb538
  Mick authored Sep 27, 2025
  
  777eb538
- Restruct gpu_memory_settings in a unify function and relax max_cuda_graph_bs (#10372) · 05a35266
  Xiaoyu Zhang authored Sep 27, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  05a35266
- Update label field comment to indicate deprecation (#10970) · e56c64bf
  Lianmin Zheng authored Sep 26, 2025
  
  e56c64bf
- ci: fix rate-limit of huggingface with hf auth login (#10947) · fff7fbab
  Mick authored Sep 27, 2025
  
  fff7fbab
- [router] remove old/oudated/useless comments across code base (#10968) · aae7ead2
  Simo Lin authored Sep 26, 2025
  
  aae7ead2
- [router] remove old/oudated/useless comments (#10967) · a7fe6e10
  Simo Lin authored Sep 26, 2025
  
  a7fe6e10
- [router] grpc router regular mode import cleanup (#10963) · be059b83
  Simo Lin authored Sep 26, 2025
  
  be059b83
- [router] add move grpc worker management from router to worker manager (#10960) · 5d4fe1ce
  Simo Lin authored Sep 26, 2025
  
  5d4fe1ce
- [router] move grpc client from router to worker and builder (#10958) · 1b011e68
  Simo Lin authored Sep 26, 2025
  
  1b011e68
- [router]fix code owner syntax error (#10956) · 5c0efa56
  Simo Lin authored Sep 26, 2025
  
  5c0efa56
- [router] add grpc client get and set (#10955) · 1e57b947
  Simo Lin authored Sep 26, 2025
  
  1e57b947
- Fuse write kv buffer into rope for qwen3 moe & bailing moe (#10749) · a5095d62
  Yuan Luo authored Sep 26, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  a5095d62
- [router] update owners for router components (#10927) · 6c2c467d
  Simo Lin authored Sep 26, 2025
  
  6c2c467d
- CI: Fix docker manifest build (#10936) · c3d2ad4e
  Sahithi Chigurupati authored Sep 25, 2025
  
  c3d2ad4e
- [PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192) · 7ec5b4e8
  hzh0425 authored Sep 26, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  7ec5b4e8
- Update CODEOWNERS to include JustinTong0323 in FC (#10939) · 60885482
  Xinyuan Tong authored Sep 25, 2025
  
  60885482
- Revert "Refactor kv_cache_scheme handling for quantization (#10132)" (#10935) · 172bcf01
  Yineng Zhang authored Sep 25, 2025
  
  172bcf01
- router: Support parallel sampling num > 1 in grpc_server and non-stream handling (#10929) · 37158f20
  Chang Su authored Sep 25, 2025
  
  37158f20
- Remove pull_request trigger from CI monitor workflow (#10932) · 3e95aa1a
  Lianmin Zheng authored Sep 25, 2025
  
  3e95aa1a
- [ci] add ci-monitor workflow (#10898) · c4197e99
  Xiaoyu Zhang authored Sep 26, 2025
  
  c4197e99
- Replace the Kimi-K2 generated tool call idx with history tool call count (#10612) · 0ac61146
  eraser00 authored Sep 26, 2025
```
Co-authored-by: eraser00 <eraser00@github.com>
```
  0ac61146
- [router][refactor] Clean up protobuf fields (#10923) · 7dcd689b
  Chang Su authored Sep 25, 2025
  
  7dcd689b
- [router] change log level to warning (#10926) · f7bab41a
  Simo Lin authored Sep 25, 2025
  
  f7bab41a
25 Sep, 2025 4 commits
- Rename customer label -> custom label (#10899) · f68dd998
  Lianmin Zheng authored Sep 25, 2025
```
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f68dd998
- [minor] Remove deprecated function `get_ip` (#10883) · 35ec2a45
  Lianmin Zheng authored Sep 25, 2025
  
  35ec2a45
- fix env flashinfer (#10910) · 0035f1ce
  Swipe4057 authored Sep 26, 2025
  
  0035f1ce
- refactor: Move `grpc/client.rs` to `grpc_client/sglang_scheduler.rs` (#10924) · 5e21d6ae
  Chang Su authored Sep 25, 2025
  
  5e21d6ae