Commits · fce170480af716482736e80217e56dd1f86a8352 · change / sglang · GitLab

25 Sep, 2025 8 commits
- integrate AIBrix KVcache (#10376) · fce17048
  yi wang authored Sep 25, 2025
  
  fce17048
- [HiCache] Cleaning the deprecated host memory state (#10778) · 3d40794f
  Zhiqiang Xie authored Sep 24, 2025
  
  3d40794f
- [ci feature] add ci monitor (#10872) · c1f39013
  Xiaoyu Zhang authored Sep 25, 2025
  
  c1f39013
- [Auto Sync] Update model_config.py (20250925) (#10885) · 3e43eb13
  Lianmin Zheng authored Sep 24, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  3e43eb13
- [router] simplify tokenizer dev doc (#10895) · 458c0219
  Simo Lin authored Sep 25, 2025
  
  458c0219
- [router] Support Oracle DB(ATP) Data Connector (#10845) · a73eb8cd
  Keyang Ru authored Sep 24, 2025
  
  a73eb8cd
- [router] consolidate worker get loads (#10880) · e7387035
  Simo Lin authored Sep 24, 2025
  
  e7387035
- [Bug] Fix Issue#10215 (#10572) · fe531d6f
  Yuhao Yao authored Sep 25, 2025
  
  fe531d6f
24 Sep, 2025 11 commits
- Restruct sgl-kernel benchmark (#10861) · c4e314f9
  Xiaoyu Zhang authored Sep 25, 2025
  
  c4e314f9
- [router] consolidate health endpoints and flush cache (#10876) · 7a06ef98
  Simo Lin authored Sep 24, 2025
  
  7a06ef98
- router-grpc: Add tools processing and other paramters for apply_chat_template (#10877) · 4a87ba21
  Chang Su authored Sep 24, 2025
  
  4a87ba21
- chore: Initial support for input config files (#10534) · d7b20dd6
  kushanam authored Sep 24, 2025
```
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d7b20dd6
- [router] select first healthy worker on proxied get requests (#10827) · c3faf2d6
  luna authored Sep 24, 2025
  
  c3faf2d6
- router-grpc: Support jinja chat template content format detection (#10832) · 9209b209
  Chang Su authored Sep 24, 2025
  
  9209b209
- ci: free space on workers for build (#10786) · adba172f
  ishandhanani authored Sep 24, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  adba172f
- fix bailing_moe with enable_dp_attention (#10860) · cd641a99
  GuoweiWangU authored Sep 24, 2025
  
  cd641a99
- feat: add cache_salt support to request (#10718) · 71f24ef8
  Xinyuan Tong authored Sep 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  71f24ef8
- Add CI timeout guidelines (#10829) · b1f0fc1c
  Lianmin Zheng authored Sep 23, 2025
  
  b1f0fc1c
- Revert "[fix][pd-disag]no need set next batch sampling info done in prefill" (#10828) · 32d89373
  Lianmin Zheng authored Sep 23, 2025
  
  32d89373
23 Sep, 2025 21 commits
- [Auto Sync] Update load_config.py, model_config.py, configu... (20250923) (#10825) · f47a2c67
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  f47a2c67
- [router] add auth middleware for api key auth (#10826) · ee704e62
  Chang Su authored Sep 23, 2025
  
  ee704e62
- [router] Support streaming for Openai Router Response api (#10822) · f4e3ebeb
  Keyang Ru authored Sep 23, 2025
  
  f4e3ebeb
- [Auto Sync] Update simple_eval_common.py (20250923) (#10824) · 312bfc4c
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
```
  312bfc4c
- [Auto Sync] Update elementwise.py (20250923) (#10823) · e290303e
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  e290303e
- fix: draft model IMA by overide max_positional_embeddings (#10787) · aab35bcc
  Xinyuan Tong authored Sep 23, 2025
```
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
```
  aab35bcc
- [Auto Sync] Update protocol.py (20250923) (#10820) · 42aedb02
  Yineng Zhang authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
```
  42aedb02
- add tunning files for QWEN-3-NEXT (#10794) · 984730b7
  Yiakwy authored Sep 24, 2025
  
  984730b7
- Fix latest main ci (#10799) · 23632d35
  Shangming Cai authored Sep 24, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  23632d35
- [router] fix axum default body limit (#10818) · 08b8c0c3
  Chang Su authored Sep 23, 2025
  
  08b8c0c3
- Remove duplicate code in qwen2 model (#10540) · d42975c6
  Lzhang-hub authored Sep 24, 2025
  
  d42975c6
- fix ceval (#10504) · adc24a3a
  ZhengHSI authored Sep 24, 2025
```
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
```
  adc24a3a
- router(grpc): Implement route for chat_cmpl endpoint (#10761) · 7ff93e61
  Chang Su authored Sep 23, 2025
  
  7ff93e61
- [router] use dashmap for radix tree instead of hash for multi model (#10814) · b24b2e7e
  Simo Lin authored Sep 23, 2025
  
  b24b2e7e
- [ROCm] Update aiter to v0.1.5.post3 (#10812) · 7135db5d
  sogalin authored Sep 24, 2025
  
  7135db5d
- [fix][pd-disag]no need set next batch sampling info done in prefill (#10259) · 4b5ef300
  Jimmy authored Sep 24, 2025
  
  4b5ef300
- model: support qwen3-vl series (#10323) · 4f564b9e
  Zheng Li authored Sep 24, 2025
```
Co-authored-by: ocss884 <ocss.lin@gmail.com>
Co-authored-by: cao1zhg <653506626@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  4f564b9e
- [router] responses api POST and GET with local storage (#10581) · 98c3b04f
  Simo Lin authored Sep 23, 2025
```
Co-authored-by: key4ng <rukeyang@gmail.com>
```
  98c3b04f
- [router] fix cache aware routing strategy and lock contention (#10773) · ddab4fc7
  Simo Lin authored Sep 23, 2025
  
  ddab4fc7
- Fix hicache mooncake backend CI (#10792) · d21c3522
  Shangming Cai authored Sep 23, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  d21c3522
- move `environ` into `sglang.srt` to avoid break SRT auto sync. (#10791) · 4a762041
  Liangsheng Yin authored Sep 23, 2025
  
  4a762041