Commits · e810077488e190c07e98022f1f16ece9f96d8e8b · change / sglang

"llm/vscode:/vscode.git/clone" did not exist on "8488388cbd4b76e58cea88578eddcbe0290bb737"

02 Oct, 2025 27 commits
- Allow use of TRTLLM_MHA backend for hybrid attention on Blackwell (#11138) · e8100774
  Dom Brown authored Oct 03, 2025
  
  e8100774
- [router][grpc] Support streaming for v1/chat/completions (#11179) · 963175d5
  Chang Su authored Oct 02, 2025
  
  963175d5
- fix: shoudn't include CUDA_ARCH 100 and 120 for cuda12.6.1 (#11176) · 0618ad6d
  gongwei-130 authored Oct 02, 2025
  
  0618ad6d
- Minor fixes for server_args, parallel_state, and test_deterministic.py (#11159) · 6a261aac
  Lianmin Zheng authored Oct 02, 2025
  
  6a261aac
- Remove dp balance metadata and minimul token balance. (#11170) · 7ff740a6
  Liangsheng Yin authored Oct 03, 2025
  
  7ff740a6
- [grpc] style fix for grpc compilation. (#11175) · bfcd9b24
  Liangsheng Yin authored Oct 03, 2025
  
  bfcd9b24
- Unify forward output datastructure (#11124) · 458611de
  Liangsheng Yin authored Oct 03, 2025
  
  458611de
- [proto] Add script to compile python protos (#11171) · 3511b370
  Chang Su authored Oct 02, 2025
  
  3511b370
- Tiny remove duplicated code (#11164) · afcd3e10
  fzyzcjy authored Oct 02, 2025
  
  afcd3e10
- Tiny fix ep_gather behavior different in CI (#11130) · 12d68183
  fzyzcjy authored Oct 02, 2025
  
  12d68183
- Tiny cleanup deepseek_v2.py (#11163) · b65db028
  fzyzcjy authored Oct 02, 2025
  
  b65db028
- fix cpp JIT compilation issue of ngram speculative decoding (#10837) · 948278f1
  b8zhong authored Oct 02, 2025
  
  948278f1
- Clean up ascend allocator (#11152) · 7d004799
  Liangsheng Yin authored Oct 02, 2025
  
  7d004799
- [model] Add mamba2 and Falcon-H1 support. (#10988) · 083629c2
  ilyasch2 authored Oct 02, 2025
```
Co-authored-by: Younes Belkada <younes.belkada@tii.ae>
Co-authored-by: Younes B <49240599+younesbelkada@users.noreply.github.com>
```
  083629c2
- [router][grpc] Support tool call parser in streaming (#11160) · b658be6f
  Chang Su authored Oct 02, 2025
  
  b658be6f
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
- Support dispatch low latency (#10263) · 0b9dfba7
  fzyzcjy authored Oct 02, 2025
```
Co-authored-by: Kaixi Hou <4001424+kaixih@users.noreply.github.com>
```
  0b9dfba7
- Remove unused pack `.item()` in paged allocator. (#11156) · 6a290034
  Liangsheng Yin authored Oct 02, 2025
  
  6a290034
- Tiny detect slow ranks (#10508) · 2ac453b0
  fzyzcjy authored Oct 02, 2025
  
  2ac453b0
- Fuse quantize and rope in trtllm_mla MTP (#10779) · f35def86
  fzyzcjy authored Oct 02, 2025
  
  f35def86
- Tiny fix missing alt stream in nextn layer (#10768) · d61615fe
  fzyzcjy authored Oct 02, 2025
  
  d61615fe
- Tiny improve dumper (#11132) · b1ccaf01
  fzyzcjy authored Oct 02, 2025
  
  b1ccaf01
- Clean up parallel_state.py (#11148) · 097725bb
  Lianmin Zheng authored Oct 02, 2025
  
  097725bb
- Fix DeepSeek chunked prefill memory issue (#11149) · 44b1fbe2
  fzyzcjy authored Oct 02, 2025
  
  44b1fbe2
- [ROCm] To reduce the compiling time when using torch compile. (#10559) · c0dbbdd1
  sogalin authored Oct 02, 2025
  
  c0dbbdd1
- Fix ngram spec with page size > 1 (#11135) · 25e7dbe8
  Liangsheng Yin authored Oct 02, 2025
  
  25e7dbe8
- Intoduce cpu tensor as metadata to avoid blocking gpu kernel launch (#10720) · 0b2aa8a7
  Zhang Junda authored Oct 02, 2025
```
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
```
  0b2aa8a7
01 Oct, 2025 13 commits
- Remove debug print statement from scheduler output (#11145) · 609f65ba
  Lianmin Zheng authored Oct 01, 2025
  
  609f65ba
- Fix metrics and request tracing (TimeStats) (#11123) · 2d62af6b
  Lianmin Zheng authored Oct 01, 2025
  
  2d62af6b
- [router] Add multi-turn tool calling loop support for MCP integration (#11143) · a28b394f
  Keyang Ru authored Oct 01, 2025
  
  a28b394f
- [router] add pd service in grpc router for pd (#11120) · 96fe2d0f
  Simo Lin authored Oct 01, 2025
  
  96fe2d0f
- [HiCache] Configurable and Dynamic Prefetch Timeout (#10512) · bfa27438
  ykwd authored Oct 01, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  bfa27438
- [Feature] Add EIC as sglang HiCache Storage backend (#10271) · 86cb4db0
  Shisong Ma authored Oct 01, 2025
```
Co-authored-by: mashisong <mashisong@bytedance.com>
```
  86cb4db0
- [HiCache]bug fix: fixed blank item in host_mem_release_queue (#11005) · 2e130b76
  zhangzuo21 authored Oct 01, 2025
```
Co-authored-by: Zuoyuan Zhang <zuoyuanzhang@ZuoyuandeMacBook-Pro.local>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  2e130b76
- feat: add fast_decode_plan from flashinfer, flashinfer to 0.4.0rc3 (#10760) · ac1f2928
  eigen authored Oct 01, 2025
```
Co-authored-by: Zihao Ye <yezihhhao@gmail.com>
Co-authored-by: Sleepcoo <Sleepcoo@gmail.com>
```
  ac1f2928
- Refactor AMD CI. (#11128) · 195a59fe
  Sai Enduri authored Oct 01, 2025
  
  195a59fe
- docker: x86 dev builds for hopper and blackwell (#11075) · 47488cc3
  ishandhanani authored Oct 01, 2025
  
  47488cc3
- Quick Fix: fix Qwen3-VL launch failure caused by MRotaryEmbedding arg (#10985) · 61305291
  yhyang201 authored Oct 01, 2025
  
  61305291
- [Doc] Update multimodal language models documentation (#11111) · a9ce2bcb
  Xinyuan Tong authored Sep 30, 2025
```
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  a9ce2bcb
- [Auto Sync] Update base_grammar_backend.py, xgrammar_backen... (20250930) (#11115) · 5dddb331
  Lianmin Zheng authored Sep 30, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  5dddb331