Commits · 968e1818261e6e4f4bbb4ec2aacb2e017667d6b8 · change / sglang

"docs/source/en/model_doc/levit.md" did not exist on "314cdf7c2583ba523a2184124cbabdc537bb38fc"

18 Aug, 2025 1 commit
- Fix triton_fused_moe unit test and benchmark (#9276) · 968e1818
  Yuan Luo authored Aug 18, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  968e1818
17 Aug, 2025 6 commits

model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067) · 845d12a9
Netanel Haber authored Aug 17, 2025
```
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
```
845d12a9
Quick Fix GLM (#9264) · e47800e1
Stefan He authored Aug 16, 2025

e47800e1
ci: simplify multi-modality tests by using mixins (#9006) · 1df84ff4
Mick authored Aug 17, 2025

1df84ff4
Bug fix: use correct mm_items in embed_mm_inputs (#8893) · 66d6be08
Binyao Jiang authored Aug 16, 2025

66d6be08

[PD] Support PD disaggregation with Prefill PP (#8846) · 384f8ab5

Shangming Cai authored Aug 17, 2025


Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: root <huzhiyuan@xiaohongshu.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Francis <38564764+ssssnow@users.noreply.github.com>
Co-authored-by: zitto <zhjc1124@gmail.com>

384f8ab5

[feature] Ascend NPU graph support (#8027) · 94371dbb

VDV1985 authored Aug 17, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

94371dbb

16 Aug, 2025 1 commit
- [CI] add deepseek w4a8 test on h20 ci (#7758) · 81da16f6
  Hank Han authored Aug 16, 2025
  
  81da16f6
15 Aug, 2025 2 commits
- [AMD] Expand test coverage for AMD CI and enable... · 9c3e95d9
  Hubert Lu authored Aug 15, 2025
```
[AMD] Expand test coverage for AMD CI and enable apply_token_bitmask_inplace_cuda in sgl-kernel (#8268)
```
  9c3e95d9
- [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) · 29589512
  Cheng Wan authored Aug 14, 2025
  
  29589512
14 Aug, 2025 2 commits
- feat: Add model version tracking with API endpoints and response metadata (#8795) · c1c7dc45
  Chengxing Xie authored Aug 15, 2025
  
  c1c7dc45
- [4/n]decouple quantization implementation from vLLM dependency (#9191) · 2cc9eeab
  Hongbo Xu authored Aug 15, 2025
```
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  2cc9eeab
13 Aug, 2025 3 commits
- [Generative Score API] Optimization to Remove Decode. (#8840) · a027a9b4
  Sundara Raman Ramachandran authored Aug 13, 2025
  
  a027a9b4
- Double vision prefill throughput by defaulting to optimal vision attention backend (#8484) · 3b3b3baf
  Kevin Xiang Li authored Aug 13, 2025
```
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
```
  3b3b3baf
- Support Triton FP8 Gemm can handle hidden_dim not divisible by 16 (#9093) · 930fe467
  Stefan He authored Aug 12, 2025
```
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  930fe467
12 Aug, 2025 3 commits

[AMD] Support Wave attention backend with AMD GPU optimizations (#8660) · 25caa7a8

jacky.cheng authored Aug 13, 2025


Signed-off-by: Stanley Winata <stanley.winata@amd.com>
Signed-off-by: Harsh Menon <harsh@nod-labs.com>
Signed-off-by: nithinsubbiah <nithinsubbiah@gmail.com>
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
Signed-off-by: xintin <gaurav.verma@amd.com>
Co-authored-by: Harsh Menon <harsh@nod-labs.com>
Co-authored-by: Stanley Winata <stanley.winata@amd.com>
Co-authored-by: Stanley Winata <68087699+raikonenfnu@users.noreply.github.com>
Co-authored-by: Stanley Winata <stanley@nod-labs.com>
Co-authored-by: Ivan Butygin <ivan.butygin@gmail.com>
Co-authored-by: nithinsubbiah <nithinsubbiah@gmail.com>
Co-authored-by: Nithin Meganathan <18070964+nithinsubbiah@users.noreply.github.com>
Co-authored-by: Ivan Butygin <ibutygin@amd.com>

25caa7a8

[Quantization] Supported w8a8 int8 quantized Gemma3 and Qwen-VL models (#8619) · 83123f48
ichernob authored Aug 12, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
83123f48
Fix broken CI TestRequestLengthValidation (#9095) · 29a610b4
Lifu Huang authored Aug 11, 2025

29a610b4

11 Aug, 2025 3 commits
- Support radix cache for Lora feature (#7216) · 75e6a7cd
  Baizhou Zhang authored Aug 11, 2025
  
  75e6a7cd
- [CI] Fix CI tests (#9050) · f003cd35
  Cheng Wan authored Aug 10, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f003cd35
- Refactor the docs (#9031) · 2449a0af
  Lianmin Zheng authored Aug 10, 2025
  
  2449a0af
10 Aug, 2025 4 commits
- Support Flatten Tensor Update Weights to speed up MOE Update Weights by 20% (#8079) · 8ecf6b9d
  Stefan He authored Aug 10, 2025
  
  8ecf6b9d
- Reduce CI duration of test_lora_update. (#9024) · e322a94d
  Lifu Huang authored Aug 10, 2025
  
  e322a94d
- Reorganize CI and test files (#9027) · 2c7f01bc
  Lianmin Zheng authored Aug 10, 2025
  
  2c7f01bc
- [RL] Add test for /abort_request (#7626) · 6345069f
  Stefan He authored Aug 10, 2025
  
  6345069f
09 Aug, 2025 6 commits
- Fix CI (#9013) · ef48d554
  Lianmin Zheng authored Aug 09, 2025
  
  ef48d554
- Fix CI (#9012) · 9a44b643
  Lianmin Zheng authored Aug 09, 2025
  
  9a44b643
- Support glm4.1v and glm4.5v (#8798) · f29aba8c
  Binyao Jiang authored Aug 09, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  f29aba8c
- Fix qwen2 audio not working bug (#8600) · 7b81f956
  Binyao Jiang authored Aug 09, 2025
  
  7b81f956
- Add CI for gpt-oss model on hopper (#8851) · 442534aa
  fzyzcjy authored Aug 09, 2025
  
  442534aa
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
08 Aug, 2025 4 commits
- Update qwen3_coder_detector.py for streaming (#8371) · b3359dc9
  maocheng23 authored Aug 08, 2025
  
  b3359dc9
- Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
  Lianmin Zheng authored Aug 08, 2025
  
  a9471542
- Support Multi Process Tokenizer Manager (#6555) · 7490e3f6
  ybyang authored Aug 08, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
```
  7490e3f6
- add zai-org/GLM-4.5-Air-FP8 model into nightly CI (#8894) · 6ee6619b
  Minglei Zhu authored Aug 08, 2025
  
  6ee6619b
07 Aug, 2025 3 commits

[Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292) · 2d120f8b

Zheng Wengang authored Aug 07, 2025

Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

2d120f8b

Enables force reasoning based on chat template for Qwen3-Thinking (#8369) · 3fa3c6cd

Xinyuan Tong authored Aug 06, 2025


Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Chang Su <csu272@usc.edu>

3fa3c6cd

Support GPU pinning for LoRA (#8697) · 6210e2c4
Lifu Huang authored Aug 06, 2025

6210e2c4

06 Aug, 2025 2 commits
- Support B200 in CI (#8861) · b114a810
  fzyzcjy authored Aug 06, 2025
  
  b114a810
- Add unit test for triton swa kernel (#8853) · 4fc5f2f9
  Ke Bao authored Aug 06, 2025
  
  4fc5f2f9