Commits · caa5d2967c975ef11c064cf8cb67b32589ca50d9 · change / sglang

29 Oct, 2025 2 commits
- feat: return partial generation results when aborting requests in waiting queue (#11673) · caa5d296
  Yuhong Guo authored Oct 29, 2025
  
  caa5d296
- [metrics][EPLB]: Support selected count of physical experts on each GPU (#9825) · 5e36a0b4
  Yingchun Lai authored Oct 29, 2025
  
  5e36a0b4
28 Oct, 2025 4 commits
- Update deepseek_v32.md (#12296) · 0ee831de
  hlu1 authored Oct 28, 2025
  
  0ee831de
- doc for logit_bias (#12188) · 9c6e25d2
  ybyang authored Oct 29, 2025
  
  9c6e25d2
- [Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 2 (#10804) · ea961060
  Feng Su authored Oct 28, 2025
```
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
```
  ea961060
- docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517) · 285a8e69
  ishandhanani authored Oct 27, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  285a8e69
27 Oct, 2025 3 commits
- Add support for Matryoshka embeddings (#126) (#11142) · 9fc3e8aa
  satyamk7054 authored Oct 27, 2025
```
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
```
  9fc3e8aa
- Add support for AutoRound quantized models (#10153) · caa4819b
  Weiwei authored Oct 27, 2025
  
  caa4819b
- chore: bump SGLang version to 0.5.4.post1 (#12169) · 55d75e11
  sglang-bot authored Oct 27, 2025
  
  55d75e11
26 Oct, 2025 5 commits
- Remove description for `--enable-beta-spec` argument (#12177) · 3f4cc0af
  Xinyuan Tong authored Oct 26, 2025
  
  3f4cc0af
- [WIP] support MiniMax M2 model (#12129) · 7ebc28f5
  赵晨阳 authored Oct 26, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Roger Young <42564206+rogeryoungh@users.noreply.github.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  7ebc28f5
- model: support NVILA and NVILA Lite (#10399) · a8023891
  Zijian Zhang authored Oct 27, 2025
  
  a8023891
- [Doc] Small update of DeepSeek v3.2 document (#12138) · 97828878
  Baizhou Zhang authored Oct 25, 2025
  
  97828878
- [docs] upd docker files names everywhere (#12133) · b4d2da10
  Vincent Zhong authored Oct 25, 2025
  
  b4d2da10
25 Oct, 2025 5 commits
- [Doc] Fix format for deepseek v3.2 document (#12130) · bcecf27e
  Baizhou Zhang authored Oct 25, 2025
  
  bcecf27e
- Update document index for DeepSeek-v32 docs (#12101) · 8e987fa2
  Baizhou Zhang authored Oct 25, 2025
  
  8e987fa2
- Clean up server args & Add CI scripts (#12124) · 4caca1ba
  Lianmin Zheng authored Oct 25, 2025
  
  4caca1ba
- Update setup_github_runner.md · ceb105a7
  Kangyan-Zhou authored Oct 25, 2025
  
  ceb105a7
- [Doc] Add documentation for DeepSeek V3.2 (#11877) · 729b2429
  Baizhou Zhang authored Oct 24, 2025
```
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  729b2429
24 Oct, 2025 6 commits
- docs(server-arguments): add allowed options for each argument (#11560) · 4b046a72
  Jonah Bernard authored Oct 24, 2025
  
  4b046a72
- fix(compile_utils, ep_moe): update environment variable and dtype check (#12034) · 14203432
  ishandhanani authored Oct 24, 2025
  
  14203432
- Revert "lang: support direct video inference" (#12038) · ffc722a6
  Lianmin Zheng authored Oct 23, 2025
  
  ffc722a6
- Fix(security): block unsafe pickle deserialization to mitigate CVE-2025-10164 (#11909) · 49afb3d9
  thelongestusernameofall authored Oct 24, 2025
```
Co-authored-by: Chengxing Xie <xiechengxing34@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  49afb3d9
- lang: support direct video inference (#9936) · 823b4429
  Mick authored Oct 24, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  823b4429
- chore: bump SGLang version to 0.5.4 (#12027) · 1053e1be
  sglang-bot authored Oct 24, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  1053e1be
23 Oct, 2025 2 commits

[Feature] Support loading weights from ckpt engine worker (#11755) · 96a5e4dd

Teng Ma authored Oct 24, 2025


Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Co-authored-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

96a5e4dd

[CPU] misc updates (#11906) · 007b849b
Zaili Wang authored Oct 23, 2025

007b849b

22 Oct, 2025 3 commits
- [Doc] Update deterministic inference flag in server_arguments.md (#11978) · 983ef22c
  Baizhou Zhang authored Oct 22, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  983ef22c
- [Documentation] add doc for deterministic inference (#11956) · 200a3c0b
  Minglei Zhu authored Oct 22, 2025
  
  200a3c0b
- Enable native ModelOpt quantization support (3/3) (#10154) · 80b2b320
  Zhiyu authored Oct 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  80b2b320
21 Oct, 2025 4 commits
- Rename flashmla kernel options of nsa backend for better readability (#11876) · ef4a8097
  Baizhou Zhang authored Oct 21, 2025
  
  ef4a8097
- Support Thinking Budget (via custom_logit_processor for OpenAI API) [Fix #6572] (#11416) · dbb16bed
  ybyang authored Oct 21, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: YorkSu <york_su@qq.com>
```
  dbb16bed
- [FEATURE] Add OpenAI-Compatible LoRA Adapter Selection (#11570) · 852c0578
  Neelabh Sinha authored Oct 21, 2025
  
  852c0578
- Init attention backend for Intel XPU (#10656) · b113c72e
  Meng, Hengyu authored Oct 21, 2025
```
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  b113c72e
20 Oct, 2025 5 commits
- [Feature] New structural tag support (#10691) · 276e7b3e
  DarkSharpness authored Oct 20, 2025
  
  276e7b3e
- Update amd gpu install docs. (#11849) · e53bf442
  Sai Enduri authored Oct 20, 2025
  
  e53bf442
- [Model] Add Olmo 3 model support (#11396) · d383e661
  Shane A authored Oct 19, 2025
  
  d383e661
- Tiny clean up for PD module and doc (#11747) · a2ba0bc3
  Shangming Cai authored Oct 20, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a2ba0bc3
- [Doc] Update documents for FA4 (#11778) · 44f0ece9
  Baizhou Zhang authored Oct 19, 2025
  
  44f0ece9
19 Oct, 2025 1 commit
- [1/2][feature] support openai like classification api (#11618) · b5e14b2b
  ybyang authored Oct 19, 2025
  
  b5e14b2b