Commits · faa25df1ae6c33162dacd31153f8c56b9da1d2db · change / sglang

09 Aug, 2025 3 commits
- Fix qwen2 audio not working bug (#8600) · 7b81f956
  Binyao Jiang authored Aug 09, 2025
  
  7b81f956
- Add CI for gpt-oss model on hopper (#8851) · 442534aa
  fzyzcjy authored Aug 09, 2025
  
  442534aa
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
08 Aug, 2025 4 commits
- Update qwen3_coder_detector.py for streaming (#8371) · b3359dc9
  maocheng23 authored Aug 08, 2025
  
  b3359dc9
- Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
  Lianmin Zheng authored Aug 08, 2025
  
  a9471542
- Support Multi Process Tokenizer Manager (#6555) · 7490e3f6
  ybyang authored Aug 08, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
```
  7490e3f6
- add zai-org/GLM-4.5-Air-FP8 model into nightly CI (#8894) · 6ee6619b
  Minglei Zhu authored Aug 08, 2025
  
  6ee6619b
07 Aug, 2025 3 commits

[Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292) · 2d120f8b

Zheng Wengang authored Aug 07, 2025

Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

2d120f8b

Enables force reasoning based on chat template for Qwen3-Thinking (#8369) · 3fa3c6cd

Xinyuan Tong authored Aug 06, 2025


Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Chang Su <csu272@usc.edu>

3fa3c6cd

Support GPU pinning for LoRA (#8697) · 6210e2c4
Lifu Huang authored Aug 06, 2025

6210e2c4

06 Aug, 2025 4 commits
- Support B200 in CI (#8861) · b114a810
  fzyzcjy authored Aug 06, 2025
  
  b114a810
- Add unit test for triton swa kernel (#8853) · 4fc5f2f9
  Ke Bao authored Aug 06, 2025
  
  4fc5f2f9
- [Feature] improve TBO: two chunk overlap (#8144) · ca47e24f
  HouseWest authored Aug 06, 2025
  
  ca47e24f
- Support bailing moe (#8680) · d26ca84f
  Praneth Paruchuri authored Aug 06, 2025
  
  d26ca84f
05 Aug, 2025 2 commits
- [feat] Add detail in image_data (#8596) · 873f384a
  Yuhao Yao authored Aug 05, 2025
  
  873f384a
- [CPU][sgl-kernel] biased_grouped_topk: fix correction_bias dtype to float32 (#8212) · 08f8f490
  Chunyuan WU authored Aug 05, 2025
```
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
```
  08f8f490
04 Aug, 2025 1 commit
- [CI] Ascend NPU CI enhancement (#8294) · fee0ab0f
  Even Zhou authored Aug 04, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  fee0ab0f
03 Aug, 2025 3 commits
- [feat] support minimum token load balance in dp attention (#7379) · f7b2853f
  Guanhua Wang authored Aug 03, 2025
  
  f7b2853f
- Support limiting max loaded loras in CPU. (#8650) · 8675bdf2
  Lifu Huang authored Aug 03, 2025
  
  8675bdf2
- [Feature] Radix Tree in C++ (#7369) · e273aa6d
  DarkSharpness authored Aug 02, 2025
  
  e273aa6d
02 Aug, 2025 1 commit
- Add tensor.detach() back to update weight util (#8691) · 4ca43b06
  Stefan He authored Aug 02, 2025
  
  4ca43b06
01 Aug, 2025 4 commits
- Fix FP8 block quantization when N or K is not multiples of 128 (#8648) · 1fe691a4
  YanbingJiang authored Aug 02, 2025
  
  1fe691a4
- Increase tolerance to address CI failures (#8643) · 46e9d1c7
  Lifu Huang authored Aug 01, 2025
  
  46e9d1c7
- [5/N] MoE Refactor: Update MoE parallelism arguments (#8658) · 6c88f6c8
  Cheng Wan authored Aug 01, 2025
  
  6c88f6c8
- Fix chat template handling for OpenAI serving (#8635) · 7e831efe
  Xinyuan Tong authored Jul 31, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  7e831efe
31 Jul, 2025 3 commits

model: support Step3V (#8583) · 51c38163

Chang Su authored Jul 31, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: nnnobody-code <nnnobody@foxmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Qiaolin-Yu <qy254@cornell.edu>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

51c38163

Bug: Fix google gemma3n-mm audio input not working bug (#8365) · 59aab76f
Binyao Jiang authored Jul 30, 2025

59aab76f
Bump transfomers to 4.54.1 to fix Gemma cache issue. (#8541) · 67e53b16
Lifu Huang authored Jul 30, 2025

67e53b16

29 Jul, 2025 1 commit
- bring back kimi vl ci (#8537) · c0fd77e8
  Stefan He authored Jul 29, 2025
  
  c0fd77e8
28 Jul, 2025 5 commits
- feat: throttle requests at scheduler based on --max_queued_requests (#7565) · 747dd450
  harrisonlimh authored Jul 28, 2025
  
  747dd450
- GLM-4.5 Model Support Follow-up (#8445) · 581e7dcb
  Binyao Jiang authored Jul 27, 2025
  
  581e7dcb
- GLM-4.5 Model Support (#8224) · 6d6a8bc2
  Yuxuan Zhang authored Jul 28, 2025
```
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
```
  6d6a8bc2
- chore: bump transformer to 4.54.0 (#8416) · 4ad97370
  Stefan He authored Jul 27, 2025
```
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
```
  4ad97370
- [feat] Support different attention backends for prefill and decode (#6338) · 28103384
  Qiaolin Yu authored Jul 27, 2025
```
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  28103384
27 Jul, 2025 5 commits
- Fix test_openai_server (#8419) · 58dd95fb
  Chang Su authored Jul 27, 2025
  
  58dd95fb
- bugfix: Fix multiple finish_reason chunks and tool_calls finish reason check (#8417) · b47eda33
  Chang Su authored Jul 27, 2025
  
  b47eda33
- Fix: Improve test_openai_function_calling unit test and fix... · e983d666
  Binyao Jiang authored Jul 27, 2025
```
Fix: Improve test_openai_function_calling unit test and fix reasoning_parser.py think_start_token logic (#8316)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  e983d666
- Support overlapped lora updates (#8213) · df906455
  Lifu Huang authored Jul 27, 2025
  
  df906455
- Support precomputed_embeddings for Llama 4 (#8156) · 44d600cd
  Kevin Xiang Li authored Jul 27, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  44d600cd
26 Jul, 2025 1 commit
- Add perf tests for LoRA (#8314) · 5c705b1d
  Lifu Huang authored Jul 26, 2025
  
  5c705b1d