Commits · 94d0f656fb6d37e028c63d953a57d7089d634e2e · change / sglang

13 Sep, 2025 1 commit
- [Performance] Dynamic Batch Tokenizer (#9382) · 94d0f656
  Sundara Raman Ramachandran authored Sep 13, 2025
  
  94d0f656
12 Sep, 2025 5 commits
- feat: add deepseek v3 fp4 ut (#10391) · 9d775b1a
  Yineng Zhang authored Sep 12, 2025
  
  9d775b1a
- add qwen3-next ut (#10355) · fe6cdf89
  Yi Zhang authored Sep 12, 2025
  
  fe6cdf89
- Support loading weights from remote instance (#8215) · 30d20ce8
  amysaq2023 authored Sep 12, 2025
```
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
Co-authored-by: Chayenne <74843776+zhaochenyang20@users.noreply.github.com>
```
  30d20ce8
- model: support Apertus (#9774) · 46d8fb1c
  EduardDurech authored Sep 12, 2025
  
  46d8fb1c
- [NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#9199) · 3df05f4d
  Shu Wang authored Sep 11, 2025
  
  3df05f4d
11 Sep, 2025 3 commits
- update GLM nightly test threshold (#10331) · 46ccbed2
  Minglei Zhu authored Sep 11, 2025
  
  46ccbed2
- [CPU] fix OOM when mem-fraction is not set (#9090) · ef959d7b
  Zaili Wang authored Sep 11, 2025
  
  ef959d7b
- [Feature] Support DeepEP normal & Redundant Experts on NPU (#9881) · 5b64f006
  Even Zhou authored Sep 11, 2025
  
  5b64f006
10 Sep, 2025 4 commits
- Feat: support disable tool parser (#10184) · f3b5db6e
  Xinyuan Tong authored Sep 10, 2025
  
  f3b5db6e
- Add tests to AMD CI for MI35x (#9662) · 91b3555d
  Hubert Lu authored Sep 10, 2025
```
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
```
  91b3555d
- Fix potential flakiness in test_lora_qwen3 (#10250) · e903f695
  Lifu Huang authored Sep 10, 2025
  
  e903f695
- [UT for RL] Add UT to cover release/resume memory case for moe model (#8803) · dccf52f9
  ryang authored Sep 10, 2025
  
  dccf52f9
09 Sep, 2025 3 commits
- [CPU] Add gelu_and_mul kernel in sgl-kernel and add ut (#9300) · d1d4074c
  blzheng authored Sep 09, 2025
  
  d1d4074c
- Support opt model (#10165) · 16ff3d4b
  wenhuipeng authored Sep 09, 2025
  
  16ff3d4b
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7
08 Sep, 2025 10 commits
- [fix] Relax white space rules in EBNFComposer (#9595) · 9a18aa54
  LukasBluebaum authored Sep 08, 2025
  
  9a18aa54
- [CI] fix ambiguous argument in testing hybrid attentions. (#10161) · 2c2b19b1
  Liangsheng Yin authored Sep 08, 2025
  
  2c2b19b1
- [Hicache]: Add E2E CI For 3FS-KVStore (#10131) · ec99668a
  hzh0425 authored Sep 08, 2025
  
  ec99668a
- Revert "enable auto-round quantization model (#6226)" (#10148) · b7d1f17b
  Yineng Zhang authored Sep 07, 2025
  
  b7d1f17b
- enable auto-round quantization model (#6226) · c8295d23
  Weiwei authored Sep 08, 2025
```
Signed-off-by: Zhang, Weiwei1 <weiwei1.zhang@intel.com>
```
  c8295d23
- [Bugfix] Qwen3MoE aclrtMemcpy failed with NPUGraph (#10013) · b67c277f
  Even Zhou authored Sep 08, 2025
  
  b67c277f
- Add speculator attention backend switch (#9981) · 8c5930f0
  cicirori authored Sep 08, 2025
  
  8c5930f0
- Add graph runner support with torch compile on CPU (#7843) · 7577f0e4
  Cao E authored Sep 08, 2025
  
  7577f0e4
- Standalone speculative decoding (#10090) · 8cda5a62
  Qiaolin Yu authored Sep 07, 2025
  
  8cda5a62
- vlm: enable GLM4.1V server testing & fix video processing (#10095) · f3440adc
  Xinyuan Tong authored Sep 08, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
```
  f3440adc
06 Sep, 2025 5 commits
- [CI] Refactor disaggregation tests (#10068) · 00974e4f
  Shangming Cai authored Sep 06, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  00974e4f
- [Fix] Compatibility between DP attention and pipeline parallelism (#10100) · 21af5c04
  Cheng Wan authored Sep 06, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  21af5c04
- [7/N] MoE Refactor: the implementation of new framework (#9269) · 3fa62da7
  Cheng Wan authored Sep 05, 2025
  
  3fa62da7
- support Llama4 with non uniformed intermediate size across layers for… (#10047) · ab62b135
  gongwei-130 authored Sep 05, 2025
  
  ab62b135
- [Minor] Refactors KV memory pool (#9842) · 273b2834
  Xinyuan Tong authored Sep 06, 2025
  
  273b2834
05 Sep, 2025 2 commits
- [Fix] Add speculative_draft_model_revision to server_args (#5255) · 13705dae
  DevashishLal-CB authored Sep 05, 2025
```
Signed-off-by: Devashish Lal <devashish@rivosinc.com>
```
  13705dae
- Simplify `Router` arguments passing and build it in docker image (#9964) · 6e95f5e5
  Liangsheng Yin authored Sep 05, 2025
  
  6e95f5e5
04 Sep, 2025 3 commits
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
- feat(hicache): Add generic hicache ci e2e test and benchmark test (#9846) · 106c2b31
  hzh0425 authored Sep 04, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  106c2b31
- feat: add gpt oss b200 ci (#9988) · de921733
  Yineng Zhang authored Sep 03, 2025
  
  de921733
03 Sep, 2025 1 commit
- Move parsers under a single folder (#9912) · 60e37f80
  Lianmin Zheng authored Sep 02, 2025
  
  60e37f80
02 Sep, 2025 1 commit

[model] support MiniCPM-V 4.0 (#8747) · 03dbf1aa

tc-mb authored Sep 03, 2025


Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

03dbf1aa

01 Sep, 2025 2 commits

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

Disable radix cache in test_lora_update.py for better stability (#9852) · 7de2ce45
Baizhou Zhang authored Aug 31, 2025

7de2ce45