Commits · 4ed57807c26e0128a649e1dc6689c9d84cce75a7 · zhaoyu6 / sglang

10 Jul, 2025 1 commit
- [feature] Add start step profile argument in /start_profile (#7608) · dd445a41
  kyleliang-nv authored Jul 09, 2025
  
  dd445a41
08 Jul, 2025 1 commit
- fix: Handles input_embeds in GenerateReqInput when n>1 (#7830) · 136c6e04
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  136c6e04
04 Jul, 2025 1 commit
- Move mem_fraction_static adjustment for multimodal models to `server_args.py`... · 14229ccf
  Lianmin Zheng authored Jul 04, 2025
```
Move mem_fraction_static adjustment for multimodal models to `server_args.py` & Fix session control & Other cleanups (#7748)
```
  14229ccf
03 Jul, 2025 2 commits
- Support updating weights at once by stopping all requests (#6698) · d3c275b1
  Albert authored Jul 03, 2025
```
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
Co-authored-by: Zilin Zhu <zhuzilinallen@gmail.com>
```
  d3c275b1
- [RL] support update_weights_from_distributed with different group and multiple weights (#7292) · 0626f678
  Zilin Zhu authored Jul 03, 2025
  
  0626f678
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
29 Jun, 2025 1 commit
- [Minor] clean up multimodal processor and tokenizer manager (#7624) · 071a1f51
  Lianmin Zheng authored Jun 29, 2025
  
  071a1f51
28 Jun, 2025 1 commit
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
27 Jun, 2025 1 commit
- Move multimodal processors into a separate folder (#7581) · ce3a3e87
  Lianmin Zheng authored Jun 27, 2025
  
  ce3a3e87
25 Jun, 2025 1 commit
- [OAI] patch origin request_id logic (#7508) · 03c039c4
  ybyang authored Jun 25, 2025
  
  03c039c4
21 Jun, 2025 2 commits
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
- [BugFix]: fix EmbeddingReqInput single input error (#7396) · 9edf6608
  woodx authored Jun 21, 2025
  
  9edf6608
19 Jun, 2025 2 commits
- Put `_normalize_rid` before other normalization in `io_struct` (#7363) · d20a073b
  Chang Su authored Jun 19, 2025
  
  d20a073b
- Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099) · 3774f078
  Stefan He authored Jun 19, 2025
  
  3774f078
16 Jun, 2025 1 commit
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
11 Jun, 2025 1 commit
- Clean up docs for server args and sampling parameters (generated by grok) (#7076) · dbdf76ca
  Lianmin Zheng authored Jun 10, 2025
  
  dbdf76ca
10 Jun, 2025 1 commit
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
09 Jun, 2025 1 commit
- feat: add direct routing strategy to DP worker (#6884) · f1569876
  ishandhanani authored Jun 09, 2025
  
  f1569876
07 Jun, 2025 1 commit
- Sync the changes on cuda graph runners (#6932) · 60fdad7c
  Lianmin Zheng authored Jun 06, 2025
  
  60fdad7c
31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
29 May, 2025 1 commit
- PD Rust LB (PO2) (#6437) · 78689d33
  Liangsheng Yin authored May 29, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  78689d33
22 May, 2025 1 commit
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
18 May, 2025 1 commit
- refactor: minor refactors regarding multimodal processing (#6187) · 01dd39ba
  Mick authored May 18, 2025
  
  01dd39ba
16 May, 2025 1 commit
- Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136) · f19a9204
  Yury Sulsky authored May 16, 2025
```
Co-authored-by: Yury Sulsky <ysulsky@tesla.com>
```
  f19a9204
12 May, 2025 1 commit
- Fix start_profile does not support with_stack and record_shapes (#6043) · 3f2702ae
  fzyzcjy authored May 12, 2025
  
  3f2702ae
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
08 May, 2025 1 commit
- [PD] Add control to slow down a server (#5572) · cef91b1e
  fzyzcjy authored May 08, 2025
  
  cef91b1e
25 Apr, 2025 1 commit
- [PD]: Support Muti Prefill in one node (#5704) · 11e27d09
  IAN authored Apr 26, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  11e27d09
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
21 Apr, 2025 1 commit
- Tiny add Engine.flush_cache API (#5241) · 11951820
  fzyzcjy authored Apr 21, 2025
  
  11951820
20 Apr, 2025 1 commit
- [PD] Fix server crash when using batch requests (#5531) · 475e2e37
  fzyzcjy authored Apr 21, 2025
  
  475e2e37
19 Apr, 2025 1 commit
- Make profiler output file names consistent (#5548) · f6a71139
  fzyzcjy authored Apr 19, 2025
  
  f6a71139
12 Apr, 2025 1 commit

Support server based rollout in Verlengine (#4848) · bc92107b

tianlian yi authored Apr 13, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jinn <47354855+jhinpan@users.noreply.github.com>

bc92107b

10 Apr, 2025 1 commit

[PD] Support KV transfer with mooncake (#4880) · 4c31ae9f

Teng Ma authored Apr 10, 2025


Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: shangmingc <csmthu@gmail.com>

4c31ae9f

08 Apr, 2025 1 commit
- [feat&refactor] Enhance multimodal input support with refactor io_struct (#4938) · d09a51f1
  XinyuanTong authored Apr 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  d09a51f1
28 Mar, 2025 2 commits
- Support with_stack and record_shapes in profiler (#4740) · 8c04f0f2
  fzyzcjy authored Mar 28, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  8c04f0f2
- Support controlling nsys start and end range programmatically (#4688) · 53a2c3b4
  fzyzcjy authored Mar 28, 2025
  
  53a2c3b4
25 Mar, 2025 3 commits
- Fix test_expert_distribution failure (#4752) · eb934bdf
  fzyzcjy authored Mar 25, 2025
  
  eb934bdf
- Add endpoints to dump selected expert ids (#4435) · 199bb01d
  yuhsaun-t authored Mar 24, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  199bb01d
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c