Commits · ceba0ce4f661722198f6568a54ba20cf06b7e033 · zhaoyu6 / sglang

20 Jun, 2025 2 commits
- support return logprobs for pipeline (#7356) · ceba0ce4
  strgrb authored Jun 20, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  ceba0ce4
- [Bugfix]Fix hang bug using dp attention with HiRadixCache (#7159) · 1d6515ef
  Huang Long authored Jun 20, 2025
```
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
```
  1d6515ef
19 Jun, 2025 3 commits
- [PD] Transfer hidden states for mtp when disaggregation (#7242) · 4f838c09
  Atream authored Jun 20, 2025
  
  4f838c09
- [Refactor] Clean up radix cache related API (#7303) · 47367b76
  DarkSharpness authored Jun 19, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  47367b76
- Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099) · 3774f078
  Stefan He authored Jun 19, 2025
  
  3774f078
18 Jun, 2025 3 commits
- Fix profiler error when there are idle passes (#7003) · 9c6a0656
  fzyzcjy authored Jun 19, 2025
  
  9c6a0656
- Upstreaming hicache bug fixes (#7267) · e56685ac
  Zhiqiang Xie authored Jun 17, 2025
  
  e56685ac
- [PD] Add custom memory pool option to support Mooncake PD with NVLink (#7264) · c26d7349
  shangmingc authored Jun 18, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  c26d7349
17 Jun, 2025 1 commit

feat: mtp support dp-attention (#6081) · 10d60cd4

u4lr451 authored Jun 17, 2025


Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>

10d60cd4

16 Jun, 2025 2 commits
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
- minor fix (#7245) · c4943867
  Liangsheng Yin authored Jun 16, 2025
  
  c4943867
15 Jun, 2025 3 commits
- [PD] use int32 for kv indices & get num_reserved_decode_tokens from server_args (#7214) · 88f9c347
  Byron Hsu authored Jun 15, 2025
  
  88f9c347
- Fix grammar abort & Minor style fixes (#7204) · 38af4f68
  Lianmin Zheng authored Jun 14, 2025
  
  38af4f68
- [PD] Support decode retract and update decode.py (#7196) · db0cc57e
  Byron Hsu authored Jun 14, 2025
  
  db0cc57e
14 Jun, 2025 1 commit
- [PD] Update prefill.py (#7190) · 7d316991
  Byron Hsu authored Jun 14, 2025
  
  7d316991
12 Jun, 2025 2 commits
- [Fix] Reduce busy polling when scheduler is idle (#6026) · bd7cfbd2
  Povilas Kanapickas authored Jun 13, 2025
  
  bd7cfbd2
- Improve log status (#7115) · 930746d9
  Liangsheng Yin authored Jun 12, 2025
  
  930746d9
09 Jun, 2025 2 commits
- Simplify prepare_extend_after_decode (#6987) · dc0705a5
  Lianmin Zheng authored Jun 09, 2025
  
  dc0705a5
- feat: add direct routing strategy to DP worker (#6884) · f1569876
  ishandhanani authored Jun 09, 2025
  
  f1569876
07 Jun, 2025 1 commit
- Tiny re-introduce profile id logging (#6912) · d5c097a2
  fzyzcjy authored Jun 07, 2025
  
  d5c097a2
06 Jun, 2025 1 commit
- Fix a bug in abort & Improve docstrings for abort (#6931) · e6b7053b
  Lianmin Zheng authored Jun 06, 2025
  
  e6b7053b
05 Jun, 2025 1 commit
- Tiny allow profiler API to auto create directory (#6865) · bcf66ef3
  fzyzcjy authored Jun 05, 2025
  
  bcf66ef3
04 Jun, 2025 1 commit
- feat: add dp-rank to KV events (#6852) · f0f84975
  ishandhanani authored Jun 04, 2025
  
  f0f84975
02 Jun, 2025 3 commits
- Fix profiles do not have consistent names (#6811) · ef21729c
  fzyzcjy authored Jun 03, 2025
  
  ef21729c
- Tiny log prefill time (#6780) · 6376b632
  fzyzcjy authored Jun 03, 2025
  
  6376b632
- Correctly abort the failed grammar requests & Improve the handling of abort (#6803) · 20fd53b8
  Lianmin Zheng authored Jun 01, 2025
  
  20fd53b8
31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
29 May, 2025 1 commit
- PD Rust LB (PO2) (#6437) · 78689d33
  Liangsheng Yin authored May 29, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  78689d33
26 May, 2025 1 commit
- Fix profiling will crash the server when using num_steps (#6586) · 8c7279c2
  fzyzcjy authored May 26, 2025
  
  8c7279c2
25 May, 2025 1 commit
- Support overlapping two batches (#4068) · 0d477880
  fzyzcjy authored May 25, 2025
  
  0d477880
24 May, 2025 1 commit
- [PD] Support structured output (#6560) · 2d831c6e
  Byron Hsu authored May 23, 2025
  
  2d831c6e
23 May, 2025 4 commits
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
- [PD] support spec decode (#6507) · d2e0881a
  Byron Hsu authored May 23, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d2e0881a
- [VLM] Support chunk prefill for VLM (#6355) · 4685fbb8
  Chang Su authored May 22, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  4685fbb8
- [PD] Fix failure abort (#6535) · 0a4fc73b
  Byron Hsu authored May 22, 2025
  
  0a4fc73b
22 May, 2025 1 commit
- [PD] Abort request if transfer fails (#6504) · 3bde1010
  Byron Hsu authored May 21, 2025
  
  3bde1010
20 May, 2025 1 commit
- Expert distribution recording without overhead for EPLB (#4957) · f0653886
  fzyzcjy authored May 20, 2025
  
  f0653886
19 May, 2025 1 commit
- [Metrics] Add KV events publishing (#6098) · 7adf245b
  Trevor Morris authored May 19, 2025
  
  7adf245b
18 May, 2025 1 commit
- Fix stop_profile does not wait for finishing (#4741) · 01d2838c
  fzyzcjy authored May 18, 2025
  
  01d2838c
17 May, 2025 1 commit
- Use monotonic clock for interval measurement (#6211) · 3cf1473a
  Lifu Huang authored May 17, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  3cf1473a