Commits · 6a3b9fd00f971234964e58b49e491ca4aed84342 · change / sglang

03 Nov, 2025 1 commit
- Update setup_github_runner.md · 6a3b9fd0
  Kangyan-Zhou authored Nov 02, 2025
  
  6a3b9fd0
01 Nov, 2025 3 commits
- [feat] Add SGLANG_TOOL_STRICT_LEVEL for tool-call behavior control (#12423) · d2a8f71c
  Xinyuan Tong authored Nov 01, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  d2a8f71c
- Forward unknown tool calls instead of dropping (#12226) · 795e98f8
  Surya-Gunukula authored Oct 31, 2025
  
  795e98f8
- chore: bump SGLang version to 0.5.4.post2 (#12439) · 41c10e67
  sglang-bot authored Nov 01, 2025
  
  41c10e67
31 Oct, 2025 2 commits
- Add env var to disable FA4 warmup (#12430) · a80bcb5a
  yinghui authored Oct 31, 2025
  
  a80bcb5a
- Revert "fix llama4 kv cache layout" (#12437) · a076ec1a
  b8zhong authored Oct 30, 2025
  
  a076ec1a
30 Oct, 2025 3 commits
- Update news section in README.md (#12409) · 7cd716f7
  Lianmin Zheng authored Oct 30, 2025
  
  7cd716f7
- Import flash_mla from sgl-kernel (#12135) · 621dfb88
  Baizhou Zhang authored Oct 29, 2025
  
  621dfb88
- [Ckpt Engine] feat: new sglang entrypoint support for update (#12216) · 32438eba
  Teng Ma authored Oct 30, 2025
  
  32438eba
29 Oct, 2025 2 commits
- feat: return partial generation results when aborting requests in waiting queue (#11673) · caa5d296
  Yuhong Guo authored Oct 29, 2025
  
  caa5d296
- [metrics][EPLB]: Support selected count of physical experts on each GPU (#9825) · 5e36a0b4
  Yingchun Lai authored Oct 29, 2025
  
  5e36a0b4
28 Oct, 2025 4 commits
- Update deepseek_v32.md (#12296) · 0ee831de
  hlu1 authored Oct 28, 2025
  
  0ee831de
- doc for logit_bias (#12188) · 9c6e25d2
  ybyang authored Oct 29, 2025
  
  9c6e25d2
- [Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 2 (#10804) · ea961060
  Feng Su authored Oct 28, 2025
```
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
```
  ea961060
- docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517) · 285a8e69
  ishandhanani authored Oct 27, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  285a8e69
27 Oct, 2025 3 commits
- Add support for Matryoshka embeddings (#126) (#11142) · 9fc3e8aa
  satyamk7054 authored Oct 27, 2025
```
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
```
  9fc3e8aa
- Add support for AutoRound quantized models (#10153) · caa4819b
  Weiwei authored Oct 27, 2025
  
  caa4819b
- chore: bump SGLang version to 0.5.4.post1 (#12169) · 55d75e11
  sglang-bot authored Oct 27, 2025
  
  55d75e11
26 Oct, 2025 5 commits
- Remove description for `--enable-beta-spec` argument (#12177) · 3f4cc0af
  Xinyuan Tong authored Oct 26, 2025
  
  3f4cc0af
- [WIP] support MiniMax M2 model (#12129) · 7ebc28f5
  赵晨阳 authored Oct 26, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Roger Young <42564206+rogeryoungh@users.noreply.github.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  7ebc28f5
- model: support NVILA and NVILA Lite (#10399) · a8023891
  Zijian Zhang authored Oct 27, 2025
  
  a8023891
- [Doc] Small update of DeepSeek v3.2 document (#12138) · 97828878
  Baizhou Zhang authored Oct 25, 2025
  
  97828878
- [docs] upd docker files names everywhere (#12133) · b4d2da10
  Vincent Zhong authored Oct 25, 2025
  
  b4d2da10
25 Oct, 2025 5 commits
- [Doc] Fix format for deepseek v3.2 document (#12130) · bcecf27e
  Baizhou Zhang authored Oct 25, 2025
  
  bcecf27e
- Update document index for DeepSeek-v32 docs (#12101) · 8e987fa2
  Baizhou Zhang authored Oct 25, 2025
  
  8e987fa2
- Clean up server args & Add CI scripts (#12124) · 4caca1ba
  Lianmin Zheng authored Oct 25, 2025
  
  4caca1ba
- Update setup_github_runner.md · ceb105a7
  Kangyan-Zhou authored Oct 25, 2025
  
  ceb105a7
- [Doc] Add documentation for DeepSeek V3.2 (#11877) · 729b2429
  Baizhou Zhang authored Oct 24, 2025
```
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  729b2429
24 Oct, 2025 6 commits
- docs(server-arguments): add allowed options for each argument (#11560) · 4b046a72
  Jonah Bernard authored Oct 24, 2025
  
  4b046a72
- fix(compile_utils, ep_moe): update environment variable and dtype check (#12034) · 14203432
  ishandhanani authored Oct 24, 2025
  
  14203432
- Revert "lang: support direct video inference" (#12038) · ffc722a6
  Lianmin Zheng authored Oct 23, 2025
  
  ffc722a6
- Fix(security): block unsafe pickle deserialization to mitigate CVE-2025-10164 (#11909) · 49afb3d9
  thelongestusernameofall authored Oct 24, 2025
```
Co-authored-by: Chengxing Xie <xiechengxing34@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  49afb3d9
- lang: support direct video inference (#9936) · 823b4429
  Mick authored Oct 24, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  823b4429
- chore: bump SGLang version to 0.5.4 (#12027) · 1053e1be
  sglang-bot authored Oct 24, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  1053e1be
23 Oct, 2025 2 commits

[Feature] Support loading weights from ckpt engine worker (#11755) · 96a5e4dd

Teng Ma authored Oct 24, 2025


Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Co-authored-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

96a5e4dd

[CPU] misc updates (#11906) · 007b849b
Zaili Wang authored Oct 23, 2025

007b849b

22 Oct, 2025 3 commits
- [Doc] Update deterministic inference flag in server_arguments.md (#11978) · 983ef22c
  Baizhou Zhang authored Oct 22, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  983ef22c
- [Documentation] add doc for deterministic inference (#11956) · 200a3c0b
  Minglei Zhu authored Oct 22, 2025
  
  200a3c0b
- Enable native ModelOpt quantization support (3/3) (#10154) · 80b2b320
  Zhiyu authored Oct 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  80b2b320
21 Oct, 2025 1 commit
- Rename flashmla kernel options of nsa backend for better readability (#11876) · ef4a8097
  Baizhou Zhang authored Oct 21, 2025
  
  ef4a8097