Commits · fa5d0bf6a5a23af1d0637ab0d666a070aeaa2a8e · change / sglang · GitLab

16 Sep, 2025 9 commits
- Remove wrong imports `from sglang.python` (#10493) · fa5d0bf6
  Liangsheng Yin authored Sep 16, 2025
  
  fa5d0bf6
- [router] add router db connector for responses api (#10487) · 16e93359
  Simo Lin authored Sep 16, 2025
  
  16e93359
- Add Logprobs unit test with a loose threshold (#10230) · f1c692f6
  Night authored Sep 16, 2025
```
Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Ryan <ryan@ryanmini.mynetworksettings.com>
```
  f1c692f6
- [ModelOpt] Respect `kv_cache_quant_algo` in ModelOpt checkpoints (#10336) · 80572c83
  brayden-hai authored Sep 15, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  80572c83
- [Hicache] Evaluate Per-Round Metrics in Multiturn Bench (#10203) · 4bb08f6e
  ykwd authored Sep 16, 2025
```
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
```
  4bb08f6e
- Temporay work-around for rocm 7.0.0 alpha with enabling data-parallel issue (#10434) · ec272dda
  kk authored Sep 16, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
```
  ec272dda
- fix crash of DeepSeek-V3 update_weights_from_disk (#8863) · a220c14f
  scut-cbq authored Sep 16, 2025
```
Co-authored-by: parkeychen <parkeychen@tencent.com>
```
  a220c14f
- [router] fix worker registration in multi model mode (#10486) · 35ef3f29
  Chang Su authored Sep 15, 2025
  
  35ef3f29
- [Auto Sync] Update registry.py (20250915) (#10484) · 31fb19a0
  Lianmin Zheng authored Sep 15, 2025
```
Co-authored-by: cctry <shiyang@x.ai>
```
  31fb19a0
15 Sep, 2025 31 commits
- [2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for... · 3f41b48c
  Lifu Huang authored Sep 15, 2025
```
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
```
  3f41b48c
- [router] multi model registration fix (#10481) · 2689f0bf
  Chang Su authored Sep 15, 2025
  
  2689f0bf
- chore: bump v0.3.10 sgl-kernel (#10478) · 52074240
  Yineng Zhang authored Sep 15, 2025
  
  52074240
- [Env] minimal version for organizing envs (#10479) · c3c26f76
  Liangsheng Yin authored Sep 16, 2025
  
  c3c26f76
- Fix `--dataset-path` in `bench_one_batch_server` (#10475) · 2cf811a9
  Liangsheng Yin authored Sep 16, 2025
  
  2cf811a9
- [1/2] Speed up trtllm_mla attention backend (>10% e2e) (#10473) · 3b25dc12
  fzyzcjy authored Sep 16, 2025
  
  3b25dc12
- fix: resolve sgl-kernel ut (#10476) · 5c08d7d2
  Yineng Zhang authored Sep 15, 2025
  
  5c08d7d2
- model: support solar (#8189) · a45d9a4e
  Praneth Paruchuri authored Sep 15, 2025
  
  a45d9a4e
- fix: gpt-oss streaming dropping normal content when tools are provided but not used (#9657) · 28c79dc8
  Jonas authored Sep 15, 2025
  
  28c79dc8
- fix(internvl): fix accuracy issue of normalization (#10375) · 1fcccda4
  Kevin Tuan authored Sep 16, 2025
  
  1fcccda4
- [CI] Fix runner for sgl-kernel (#9887) · 79acec4f
  Sahithi Chigurupati authored Sep 15, 2025
```
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com>
```
  79acec4f
- [PD metrics] Add latency Histogram metrics of each stage for generate requests (#8710) · b1721edb
  Yingchun Lai authored Sep 16, 2025
  
  b1721edb
- [bugfix] fix typo (#10471) · 57234d0c
  Jiayi Yan authored Sep 15, 2025
  
  57234d0c
- [router] minor code clean up in server startup (#10470) · b93acd70
  Chang Su authored Sep 15, 2025
  
  b93acd70
- chore: bump v0.5.3rc0 (#10468) · 86a32bb5
  Yineng Zhang authored Sep 15, 2025
  
  86a32bb5
- feat: support pip install sglang (#10465) · 5afd0365
  Yineng Zhang authored Sep 15, 2025
  
  5afd0365
- Fix trtllm_moe wrong correction bias (#10440) · 059c13de
  fzyzcjy authored Sep 15, 2025
  
  059c13de
- Run tests based on labels (#10456) · 50dc0c1e
  Lianmin Zheng authored Sep 15, 2025
  
  50dc0c1e
- Add rtx5880 moe triton (#10439) · 76becc1d
  Jimmy_L authored Sep 15, 2025
  
  76becc1d
- [HotFix]: Hot fix import path in 3fs_bench_client.py (#10463) · 2a37b24d
  hzh0425 authored Sep 15, 2025
  
  2a37b24d
- Update GITHUB_TOKEN secret for documentation push (#10458) · f73aae0b
  Lianmin Zheng authored Sep 14, 2025
  
  f73aae0b
- [router] fix logger ordering git ctx (#10457) · 69b35793
  Chang Su authored Sep 14, 2025
  
  69b35793
- [router] add dependency for router (#10401) · 957482c8
  ooapex authored Sep 15, 2025
  
  957482c8
- fix(server_args): Skip chunked_prefill_size validation when disaggregation mode is decode (#10358) · 3795b6a4
  Jimmy authored Sep 15, 2025
  
  3795b6a4
- [router] fix service discovery and mcp ut (#10449) · 7eccbe99
  Simo Lin authored Sep 15, 2025
  
  7eccbe99
- fix: fix max_new_tokens uninitialized error (#9343) · 0549f21c
  Mick authored Sep 15, 2025
  
  0549f21c
- [CI] Fix token key in label-pr.yml workflow (#10452) · b354e3c9
  Lianmin Zheng authored Sep 14, 2025
  
  b354e3c9
- Update permissions in label-pr.yml (#10450) · 65e6f48c
  Lianmin Zheng authored Sep 14, 2025
  
  65e6f48c
- Fix label PR (#10445) · 0ec580a8
  Lianmin Zheng authored Sep 14, 2025
  
  0ec580a8
- Add reasoning examples for GPT-OSS in Markdown examples (#9626) · 0b14159f
  Vincent Zhong authored Sep 14, 2025
  
  0b14159f
- [docs / oneliner] update mmmu docs instruction (#9768) · 1489cd6c
  Vincent Zhong authored Sep 14, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1489cd6c