Commits · 706bd69cc58aefb7c0a4d7b269f1cbe2908f955b · change / sglang · GitLab

09 Aug, 2025 1 commit
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
08 Aug, 2025 2 commits

Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
Lianmin Zheng authored Aug 08, 2025

a9471542

Support Multi Process Tokenizer Manager (#6555) · 7490e3f6

ybyang authored Aug 08, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>

7490e3f6

06 Aug, 2025 1 commit
- Support B200 in CI (#8861) · b114a810
  fzyzcjy authored Aug 06, 2025
  
  b114a810
04 Aug, 2025 1 commit
- [CI] Ascend NPU CI enhancement (#8294) · fee0ab0f
  Even Zhou authored Aug 04, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  fee0ab0f
28 Jul, 2025 2 commits
- feat: throttle requests at scheduler based on --max_queued_requests (#7565) · 747dd450
  harrisonlimh authored Jul 28, 2025
  
  747dd450
- [feat] Support different attention backends for prefill and decode (#6338) · 28103384
  Qiaolin Yu authored Jul 27, 2025
```
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  28103384
26 Jul, 2025 1 commit

Extract update_weights from RL Engine to SGLang to keep simplicity and fix torch reduce (#8267) · ce32bc2b

Stefan He authored Jul 26, 2025

Co-authored-by: CuiBo 82354186+SuperCB@users.noreply.github.com
Co-authored-by: GeLee 865038696@qq.com
Co-authored-by: 杨睿 yangruipis@163.com

ce32bc2b

23 Jul, 2025 2 commits
- Fix gemma3n with hybrid swa (#8240) · 38000a5f
  Xinyuan Tong authored Jul 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  38000a5f
- Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) · 8abd3e77
  Lifu Huang authored Jul 23, 2025
  
  8abd3e77
20 Jul, 2025 1 commit
- Add get_hidden_dim to qwen3.py for correct lora (#7312) · 877e35d7
  Pavel Logachev authored Jul 20, 2025
  
  877e35d7
19 Jul, 2025 2 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Fix LoRA buffer contamination during adapter eviction (#8103) · 3de617a7
  Lifu Huang authored Jul 19, 2025
  
  3de617a7
18 Jul, 2025 3 commits
- [Doc] Steps to add a new attention backend (#8155) · 9c7a4618
  Lianmin Zheng authored Jul 18, 2025
  
  9c7a4618
- [AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661) · 7750b91c
  Hubert Lu authored Jul 18, 2025
  
  7750b91c
- Hicache Storage Layer Prototype (#7704) · 9d33fcfb
  Zhiqiang Xie authored Jul 18, 2025
  
  9d33fcfb
14 Jul, 2025 1 commit
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
10 Jul, 2025 1 commit
- [feature] Add start step profile argument in /start_profile (#7608) · dd445a41
  kyleliang-nv authored Jul 09, 2025
  
  dd445a41
09 Jul, 2025 1 commit
- [CI] Add deepep tests to CI (#7872) · d487555f
  Cheng Wan authored Jul 09, 2025
  
  d487555f
08 Jul, 2025 2 commits
- fix: Handles input_embeds in GenerateReqInput when n>1 (#7830) · 136c6e04
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  136c6e04
- [Minor] Fix sporadic CI timeout caused by underestimated tests. (#7850) · 2b0e1d1c
  Lifu Huang authored Jul 08, 2025
  
  2b0e1d1c
06 Jul, 2025 1 commit
- [AMD] Add test_fused_moe.py and test_rope_rocm.py to AMD CI (#5246) · e00715eb
  Hubert Lu authored Jul 06, 2025
  
  e00715eb
04 Jul, 2025 1 commit
- Add V2-lite model test (#7390) · 4de03953
  YanbingJiang authored Jul 04, 2025
```
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  4de03953
03 Jul, 2025 1 commit

Ascend attention backend(PA&MLA) (#7722) · 1e0e5497

ronnie_zheng authored Jul 03, 2025


Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>

1e0e5497

02 Jul, 2025 1 commit
- [AMD] Temporarily disable test_no_overlap_scheduler and test_vision_chunked_prefill (#7717) · b116b21a
  Hubert Lu authored Jul 02, 2025
  
  b116b21a
30 Jun, 2025 2 commits
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
- [CPU] add c++ kernel to bind CPU cores and memory node (#7524) · c5131f7a
  Chunyuan WU authored Jun 30, 2025
  
  c5131f7a
29 Jun, 2025 1 commit
- Fix stream reasoning parser and Adds Kimi reasoning parser (#7432) · 8f335b5b
  Xinyuan Tong authored Jun 29, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8f335b5b
28 Jun, 2025 3 commits
- fix unit tests (#7618) · a8c10aee
  Yineng Zhang authored Jun 28, 2025
  
  a8c10aee
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
27 Jun, 2025 1 commit
- Add e2e test for multi instance multi stage memory release/resume occupuation (#7208) · 031f64aa
  Ata Fatahi authored Jun 26, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  031f64aa
23 Jun, 2025 1 commit
- ci: Revert openai_server related tests in AMD suites (#7449) · fa42e419
  Chang Su authored Jun 23, 2025
  
  fa42e419
22 Jun, 2025 1 commit
- refactor(test): reorganize OpenAI test file structure (#7408) · b7a2df0a
  Chang Su authored Jun 21, 2025
  
  b7a2df0a
21 Jun, 2025 1 commit
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
20 Jun, 2025 1 commit
- Purge VerlEngine (#7326) · 1ab6be1b
  Ata Fatahi authored Jun 19, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  1ab6be1b
19 Jun, 2025 1 commit
- Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099) · 3774f078
  Stefan He authored Jun 19, 2025
  
  3774f078
18 Jun, 2025 2 commits
- Add more refactored openai test & in CI (#7284) · ffd1a26e
  Jinn authored Jun 18, 2025
  
  ffd1a26e
- Update python API of activation, topk, norm and rope and remove vllm dependency (#6614) · 094c116f
  YanbingJiang authored Jun 18, 2025
```
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: sdp <sdp@gnr799219.jf.intel.com>
```
  094c116f
16 Jun, 2025 1 commit
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368