Commits · d7056c5236483d247cf0f4f149e3c7e72767efab · change / sglang

24 Oct, 2025 6 commits
- docs(server-arguments): add allowed options for each argument (#11560) · 4b046a72
  Jonah Bernard authored Oct 24, 2025
  
  4b046a72
- fix(compile_utils, ep_moe): update environment variable and dtype check (#12034) · 14203432
  ishandhanani authored Oct 24, 2025
  
  14203432
- Revert "lang: support direct video inference" (#12038) · ffc722a6
  Lianmin Zheng authored Oct 23, 2025
  
  ffc722a6
- Fix(security): block unsafe pickle deserialization to mitigate CVE-2025-10164 (#11909) · 49afb3d9
  thelongestusernameofall authored Oct 24, 2025
```
Co-authored-by: Chengxing Xie <xiechengxing34@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  49afb3d9
- lang: support direct video inference (#9936) · 823b4429
  Mick authored Oct 24, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  823b4429
- chore: bump SGLang version to 0.5.4 (#12027) · 1053e1be
  sglang-bot authored Oct 24, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  1053e1be
23 Oct, 2025 2 commits

[Feature] Support loading weights from ckpt engine worker (#11755) · 96a5e4dd

Teng Ma authored Oct 24, 2025


Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Co-authored-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

96a5e4dd

[CPU] misc updates (#11906) · 007b849b
Zaili Wang authored Oct 23, 2025

007b849b

22 Oct, 2025 3 commits
- [Doc] Update deterministic inference flag in server_arguments.md (#11978) · 983ef22c
  Baizhou Zhang authored Oct 22, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  983ef22c
- [Documentation] add doc for deterministic inference (#11956) · 200a3c0b
  Minglei Zhu authored Oct 22, 2025
  
  200a3c0b
- Enable native ModelOpt quantization support (3/3) (#10154) · 80b2b320
  Zhiyu authored Oct 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  80b2b320
21 Oct, 2025 4 commits
- Rename flashmla kernel options of nsa backend for better readability (#11876) · ef4a8097
  Baizhou Zhang authored Oct 21, 2025
  
  ef4a8097
- Support Thinking Budget (via custom_logit_processor for OpenAI API) [Fix #6572] (#11416) · dbb16bed
  ybyang authored Oct 21, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: YorkSu <york_su@qq.com>
```
  dbb16bed
- [FEATURE] Add OpenAI-Compatible LoRA Adapter Selection (#11570) · 852c0578
  Neelabh Sinha authored Oct 21, 2025
  
  852c0578
- Init attention backend for Intel XPU (#10656) · b113c72e
  Meng, Hengyu authored Oct 21, 2025
```
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  b113c72e
20 Oct, 2025 5 commits
- [Feature] New structural tag support (#10691) · 276e7b3e
  DarkSharpness authored Oct 20, 2025
  
  276e7b3e
- Update amd gpu install docs. (#11849) · e53bf442
  Sai Enduri authored Oct 20, 2025
  
  e53bf442
- [Model] Add Olmo 3 model support (#11396) · d383e661
  Shane A authored Oct 19, 2025
  
  d383e661
- Tiny clean up for PD module and doc (#11747) · a2ba0bc3
  Shangming Cai authored Oct 20, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a2ba0bc3
- [Doc] Update documents for FA4 (#11778) · 44f0ece9
  Baizhou Zhang authored Oct 19, 2025
  
  44f0ece9
19 Oct, 2025 1 commit
- [1/2][feature] support openai like classification api (#11618) · b5e14b2b
  ybyang authored Oct 19, 2025
  
  b5e14b2b
18 Oct, 2025 4 commits
- support server arg override KV cache to bf16 to avoid slow cases (#11749) · f9a7d9b3
  b8zhong authored Oct 18, 2025
  
  f9a7d9b3
- Fix install instructions and pyproject.tomls (#11781) · 67e34c56
  Lianmin Zheng authored Oct 18, 2025
  
  67e34c56
- fix command line usage of profiling (#11793) · 547003bd
  Qiaolin Yu authored Oct 17, 2025
  
  547003bd
- Set CUDA_VISIBLE_DEVICES to achieve one GPU per process (#9170) · 9eefe2c0
  Lianmin Zheng authored Oct 17, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Cheng Wan <cwan@x.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  9eefe2c0
17 Oct, 2025 2 commits
- [minor] sync code on python/sglang/test/test_deterministic.py and improve ci tests (#11777) · b9a54e09
  Lianmin Zheng authored Oct 17, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  b9a54e09
- [doc] update router document (#11767) · 2bc3fcd4
  Keyang Ru authored Oct 17, 2025
  
  2bc3fcd4
16 Oct, 2025 2 commits
- chore: bump SGLang version to 0.5.3.post3 (#11693) · 85ebeecf
  sglang-bot authored Oct 16, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  85ebeecf
- Sync code and test CI; rename some env vars (#11686) · cd7e1bd5
  Lianmin Zheng authored Oct 15, 2025
  
  cd7e1bd5
15 Oct, 2025 6 commits
- chore: bump SGLang version to 0.5.3.post2 (#11680) · baf277a9
  sglang-bot authored Oct 15, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  baf277a9
- [sgl-kernel] Optimize gguf test (#11667) · 54644572
  Fan Yin authored Oct 16, 2025
  
  54644572
- docs: update sglang installation guide (#11659) · ab9187a2
  Yineng Zhang authored Oct 15, 2025
  
  ab9187a2
- [Doc] Update support matrix for attn and hybrid attn (#11293) · 6bc503af
  b8zhong authored Oct 14, 2025
  
  6bc503af
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
- [router] update router doc to latest features (#11639) · e0c2af2a
  Simo Lin authored Oct 14, 2025
  
  e0c2af2a
14 Oct, 2025 5 commits
- Update install.md (#11631) · d314bf60
  Lianmin Zheng authored Oct 14, 2025
  
  d314bf60
- [Docs] [Router]: Update sg-router doc on circuit breaker (#11449) · 642fa966
  Wenyi Xu authored Oct 14, 2025
  
  642fa966
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
- bench_serving support PD Disaggregation (#11542) · 88a6f9da
  Xiaoyu Zhang authored Oct 14, 2025
  
  88a6f9da
- [FEATURE] Add Profile Trace Merger for Distributed Traces (#11413) · aaf7af1b
  Neelabh Sinha authored Oct 13, 2025
  
  aaf7af1b