Commits · 770d63123c70f4eeb2d69c7268154cb0204e3e93 · change / sglang · GitLab

24 Oct, 2025 33 commits
- [router] fix ut router config init to use build pattern (#12084) · 770d6312
  Simo Lin authored Oct 24, 2025
  
  770d6312
- fix(compile_utils, ep_moe): update environment variable and dtype check (#12034) · 14203432
  ishandhanani authored Oct 24, 2025
  
  14203432
- [router] implement response api get input item function and refactor input/output store (#11924) · d7f0d88f
  Keyang Ru authored Oct 24, 2025
  
  d7f0d88f
- adjust dynamic vs static outputs comparison in test_lora_update.py (#11884) · fc86b18b
  Glen Liu authored Oct 24, 2025
  
  fc86b18b
- [Fix]: HiCache hasher failed when EAGLE mode enabled (#12025) · 0bfa394a
  Yuanhang Sun authored Oct 24, 2025
  
  0bfa394a
- Fix multi processing serializer bug (#11958) · e04340bf
  fzyzcjy authored Oct 24, 2025
  
  e04340bf
- [b200] fix piecewise cuda graph launch bug (#12067) · 84701338
  Xiaoyu Zhang authored Oct 24, 2025
  
  84701338
- [Profiler] expand '~' for `torch_profiler_output_dir` (#11999) · 93ef9a09
  Muqi Li authored Oct 24, 2025
  
  93ef9a09
- Add 'gguf' to project dependencies (#12046) · b04cd3d4
  Muqi Li authored Oct 24, 2025
  
  b04cd3d4
- Revise POINTSV15Chat model (#12049) · 7ef5d8af
  Yuan Luo authored Oct 24, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  7ef5d8af
- Fix dpsk-r1-fp4 launching crash (#12063) · 71d41212
  Qiaolin Yu authored Oct 24, 2025
  
  71d41212
- fix: bench_serving ITL calculation when using spec-decoding (#12064) · b9fb74f3
  Xinyuan Tong authored Oct 24, 2025
  
  b9fb74f3
- [Fix] fix missing `ipc_name` of `__getitem__` in some IO structs (#12053) · e15b63a1
  ybyang authored Oct 24, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
```
  e15b63a1
- Refactoring GLM-4.5 and GLM-4.5V related implementations (#11800) · 4060ed37
  Yuxuan Zhang authored Oct 24, 2025
  
  4060ed37
- Tiny cleanup send_single (#12056) · 2342605e
  fzyzcjy authored Oct 24, 2025
  
  2342605e
- [router] Add mTLS Support for Router-to-Worker Communication (#12019) · dbf17a83
  Simo Lin authored Oct 23, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  dbf17a83
- Install numactl in Dockerfile for GH200/GB200/GB300 (#11853) · 0f0c430e
  fzyzcjy authored Oct 24, 2025
  
  0f0c430e
- fix: the hardcode hf repo name comparison for deepseek-ocr (#12031) · 8e797a47
  Rain Jiang authored Oct 23, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  8e797a47
- Add gguf dependency for cpu/xpu (#12041) · aa3003f1
  Zaili Wang authored Oct 24, 2025
  
  aa3003f1
- Opt MHA chunked prefix: merge prefix and extend kv cache to run mha once (#10953) · 4793ec7d
  Yongfei Xu authored Oct 24, 2025
  
  4793ec7d
- fix: fix MMMU loading issue (#11759) · 92009bd2
  Zaili Wang authored Oct 24, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  92009bd2
- Revert "[Fix] Fix lint to pass CI" (#12042) · 4ef981e2
  Baizhou Zhang authored Oct 23, 2025
  
  4ef981e2
- [Fix] Fix lint to pass CI (#12037) · 69ed8b67
  Baizhou Zhang authored Oct 23, 2025
  
  69ed8b67
- support more model in piecewise cuda graph (#11745) · 1801cd19
  narutolhy authored Oct 23, 2025
  
  1801cd19
- Revert "lang: support direct video inference" (#12038) · ffc722a6
  Lianmin Zheng authored Oct 23, 2025
  
  ffc722a6
- Fix(security): block unsafe pickle deserialization to mitigate CVE-2025-10164 (#11909) · 49afb3d9
  thelongestusernameofall authored Oct 24, 2025
```
Co-authored-by: Chengxing Xie <xiechengxing34@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  49afb3d9
- Use flashinfer_trtllm moe runner backend to gain around 10% perf on b200 fp8 dpsk (#11816) · f80371ff
  b8zhong authored Oct 23, 2025
  
  f80371ff
- Refactor Triton-kernel MoE runner integration (#11795) · 62eff37b
  Jonah Bernard authored Oct 23, 2025
  
  62eff37b
- Enable Llama 4 + TRTLLM MHA (#12003) · 47e12e08
  b8zhong authored Oct 23, 2025
  
  47e12e08
- lang: support direct video inference (#9936) · 823b4429
  Mick authored Oct 24, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  823b4429
- [8/n] decouple quantization impl from vllm dependency - gguf srt (#11964) · 14a4d80e
  Fan Yin authored Oct 24, 2025
```
Co-authored-by: Peng Zhang <zhuangsen.zp@antgroup.com>
```
  14a4d80e
- chore: bump SGLang version to 0.5.4 (#12027) · 1053e1be
  sglang-bot authored Oct 24, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  1053e1be
- Fixed aarch64 flash-mla (#12009) · 9a71500c
  nvjullin authored Oct 24, 2025
  
  9a71500c
23 Oct, 2025 7 commits
- [router] Add builder pattern for RouterConfig with zero duplication (#12030) · 6d6e24bc
  Simo Lin authored Oct 23, 2025
  
  6d6e24bc
- Update Github action title for kernel build (#12029) · 2c057fbf
  Kangyan-Zhou authored Oct 23, 2025
  
  2c057fbf
- Fix mamba radix cache eviction logic in `alloc_req_slots` (#11616) · dbd9435d
  Roger Young authored Oct 24, 2025
```
Signed-off-by: rogeryoungh <rogeryoungh@foxmail.com>
```
  dbd9435d
- Revert "[ROCm] Remove vLLM rope dependency & use AITER impl" (#12028) · 8ae9d4bb
  b8zhong authored Oct 23, 2025
  
  8ae9d4bb
- Log iteration # for prefill and decode (#9366) · 1c304aa9
  Nicolas Castet authored Oct 23, 2025
  
  1c304aa9
- model: support deepseek-ocr (#11891) · 770529a7
  Mick authored Oct 24, 2025
```
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  770529a7
- Add AWQ quantization support for NPU. (#10158) · 39c237f0
  ErvinXie authored Oct 24, 2025
```
Co-authored-by: Alisehen <814073252@qq.com>
Co-authored-by: Yaochen Han <48639761+Alisehen@users.noreply.github.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
```
  39c237f0