Commits · e1d45bc280e4eb8954da84dea69e0026ca6ec470 · change / sglang · GitLab

17 Sep, 2025 4 commits
- Fix decord dependency for aarch64 docker build (#10529) · e1d45bc2
  kyleliang-nv authored Sep 16, 2025
  
  e1d45bc2
- feat: add priority based scheduling with priority based request acceptance and preemption (#8746) · 14fdd527
  harrisonlimh authored Sep 16, 2025
  
  14fdd527
- [Auto Sync] Update activation.py, chunk_cache.py, utils.py (20250917) (#10538) · f949ad57
  Lianmin Zheng authored Sep 16, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  f949ad57
- [Auto Sync] Update scheduler_profiler_mixin.py, rpd_utils.p... (20250916) (#10494) · c49484a6
  Lianmin Zheng authored Sep 16, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
```
  c49484a6
16 Sep, 2025 23 commits
- support using fa4 on deepseek on blackwell (#9928) · a2f7218a
  cicirori authored Sep 17, 2025
  
  a2f7218a
- [2/2] Speed up trtllm_mla attention backend (#10474) · 311de47b
  fzyzcjy authored Sep 17, 2025
  
  311de47b
- skip vision_model for lora (#10530) · 373080ea
  gongwei-130 authored Sep 16, 2025
  
  373080ea
- Fix formatting in long code blocks (#10528) · 7f028b07
  Philip Kiely - Baseten authored Sep 16, 2025
  
  7f028b07
- adjust import setuptools_rust (#10524) · 0abb41c7
  ybyang authored Sep 16, 2025
  
  0abb41c7
- [CPU] fix CPU backend sel. issue for Llama4 (#10511) · 925dbb32
  Zaili Wang authored Sep 16, 2025
  
  925dbb32
- Support sgl-router parallel_batch in bench_one_batch_server (#10506) · 8df7353a
  fzyzcjy authored Sep 16, 2025
  
  8df7353a
- Fix CI when sgl-kernel is changed but srt is not changed (#10515) · ae4be601
  fzyzcjy authored Sep 16, 2025
  
  ae4be601
- Update CUTLASS. Refine KernelSchedule for fp8 (grouped) gemm. (#10491) · 9b876889
  Qi Yuhang authored Sep 16, 2025
  
  9b876889
- chore: upgrade sgl-kernel 0.3.10 (#10500) · c0c6f543
  Yineng Zhang authored Sep 16, 2025
  
  c0c6f543
- Minor fix lint introduced by #10466 (#10507) · edd6a07b
  Shangming Cai authored Sep 16, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  edd6a07b
- feat: update support for qwen3next model (#10466) · b6dd4bcb
  cao1zhg authored Sep 16, 2025
  
  b6dd4bcb
- Cache the result of `is_blackwell` platform check (#10498) · b2435be6
  b8zhong authored Sep 15, 2025
  
  b2435be6
- [router] fix router manager and router init in server (#10499) · 5fe39e85
  Chang Su authored Sep 15, 2025
  
  5fe39e85
- Remove wrong imports `from sglang.python` (#10493) · fa5d0bf6
  Liangsheng Yin authored Sep 16, 2025
  
  fa5d0bf6
- [router] add router db connector for responses api (#10487) · 16e93359
  Simo Lin authored Sep 16, 2025
  
  16e93359
- Add Logprobs unit test with a loose threshold (#10230) · f1c692f6
  Night authored Sep 16, 2025
```
Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Ryan <ryan@ryanmini.mynetworksettings.com>
```
  f1c692f6
- [ModelOpt] Respect `kv_cache_quant_algo` in ModelOpt checkpoints (#10336) · 80572c83
  brayden-hai authored Sep 15, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  80572c83
- [Hicache] Evaluate Per-Round Metrics in Multiturn Bench (#10203) · 4bb08f6e
  ykwd authored Sep 16, 2025
```
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
```
  4bb08f6e
- Temporay work-around for rocm 7.0.0 alpha with enabling data-parallel issue (#10434) · ec272dda
  kk authored Sep 16, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
```
  ec272dda
- fix crash of DeepSeek-V3 update_weights_from_disk (#8863) · a220c14f
  scut-cbq authored Sep 16, 2025
```
Co-authored-by: parkeychen <parkeychen@tencent.com>
```
  a220c14f
- [router] fix worker registration in multi model mode (#10486) · 35ef3f29
  Chang Su authored Sep 15, 2025
  
  35ef3f29
- [Auto Sync] Update registry.py (20250915) (#10484) · 31fb19a0
  Lianmin Zheng authored Sep 15, 2025
```
Co-authored-by: cctry <shiyang@x.ai>
```
  31fb19a0
15 Sep, 2025 13 commits
- [2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for... · 3f41b48c
  Lifu Huang authored Sep 15, 2025
```
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
```
  3f41b48c
- [router] multi model registration fix (#10481) · 2689f0bf
  Chang Su authored Sep 15, 2025
  
  2689f0bf
- chore: bump v0.3.10 sgl-kernel (#10478) · 52074240
  Yineng Zhang authored Sep 15, 2025
  
  52074240
- [Env] minimal version for organizing envs (#10479) · c3c26f76
  Liangsheng Yin authored Sep 16, 2025
  
  c3c26f76
- Fix `--dataset-path` in `bench_one_batch_server` (#10475) · 2cf811a9
  Liangsheng Yin authored Sep 16, 2025
  
  2cf811a9
- [1/2] Speed up trtllm_mla attention backend (>10% e2e) (#10473) · 3b25dc12
  fzyzcjy authored Sep 16, 2025
  
  3b25dc12
- fix: resolve sgl-kernel ut (#10476) · 5c08d7d2
  Yineng Zhang authored Sep 15, 2025
  
  5c08d7d2
- model: support solar (#8189) · a45d9a4e
  Praneth Paruchuri authored Sep 15, 2025
  
  a45d9a4e
- fix: gpt-oss streaming dropping normal content when tools are provided but not used (#9657) · 28c79dc8
  Jonas authored Sep 15, 2025
  
  28c79dc8
- fix(internvl): fix accuracy issue of normalization (#10375) · 1fcccda4
  Kevin Tuan authored Sep 16, 2025
  
  1fcccda4
- [CI] Fix runner for sgl-kernel (#9887) · 79acec4f
  Sahithi Chigurupati authored Sep 15, 2025
```
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com>
```
  79acec4f
- [PD metrics] Add latency Histogram metrics of each stage for generate requests (#8710) · b1721edb
  Yingchun Lai authored Sep 16, 2025
  
  b1721edb
- [bugfix] fix typo (#10471) · 57234d0c
  Jiayi Yan authored Sep 15, 2025
  
  57234d0c