Commits · c44e985dc20ec79dcf4e64a9c1f6b8fa395d853b · change / sglang

18 Oct, 2025 1 commit

feat(example/fastapi): support --startup-timeout using... · c44e985d

Kindyaa authored Oct 19, 2025

feat(example/fastapi): support --startup-timeout using Qwen3-Next-80B-A3B-Instruct as example (#11710)
Co-authored-by: chenan01 <chenan01@cheche-MacBook-Pro.local>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c44e985d

05 Oct, 2025 1 commit
- Add DeepSeek-V3.2 Tool Call Template (#11063) · 85c1f793
  Xu Wenqing authored Oct 05, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  85c1f793
03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
19 Sep, 2025 1 commit
- model support: Sarashina2VisionForCausalLM (#10632) · c1815a99
  Chang Su authored Sep 18, 2025
  
  c1815a99
14 Sep, 2025 1 commit

[Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 1 (#9962) · 4c21b090

Feng Su authored Sep 15, 2025


Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
Signed-off-by: Huaixin Chang <changhuaixin@linux.alibaba.com>
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>

4c21b090

09 Sep, 2025 1 commit
- tool-call(dsv3): Fixed a parse problem when there are multiple function... · 2cd94dd0
  Yiming authored Sep 09, 2025
```
tool-call(dsv3): Fixed a parse problem when there are multiple function definitions in tool_calls (#10209)
```
  2cd94dd0
03 Sep, 2025 3 commits
- nsys profile output kernel classifier (#9314) · 73179b76
  Grace Ho authored Sep 03, 2025
```
Signed-off-by: Grace Ho <grho@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  73179b76
- Update tool_chat_template_deepseekv31.jinja (#9895) · cc9a31c6
  南京小汤包 authored Sep 03, 2025
  
  cc9a31c6
- Move parsers under a single folder (#9912) · 60e37f80
  Lianmin Zheng authored Sep 02, 2025
  
  60e37f80
28 Aug, 2025 2 commits
- fix: fix MLA for ShardedModelLoader/RemoteModelLoader (#6287) · 9f81d741
  wangyu authored Aug 29, 2025
```
Signed-off-by: wangyu <wangyu.steph@bytedance.com>
```
  9f81d741
- feat(draft_model): support draft_model for RemoteModelLoader (#6407) · a38c1497
  wangyu authored Aug 29, 2025
```
Signed-off-by: wangyu <wangyu.steph@bytedance.com>
```
  a38c1497
27 Aug, 2025 1 commit

Support DeepSeek-V3.1 tool call (#9446) · b9683be6

Xu Wenqing authored Aug 27, 2025


Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

b9683be6

23 Aug, 2025 1 commit
- tool-call(dsv3): Improve deepseek-v3 chat template and tool_choice = `required` (#9525) · c9dd70fb
  Chang Su authored Aug 23, 2025
  
  c9dd70fb
07 Aug, 2025 1 commit
- [Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949) · b7cd7430
  PGFLMG authored Aug 07, 2025
  
  b7cd7430
31 Jul, 2025 1 commit
- [bugfix] Fix 2 minor bugs in the hicache storage layer (#8404) · 5963e505
  yi wang authored Jul 31, 2025
  
  5963e505
21 Jun, 2025 1 commit
- Remove batches api in docs & example (#7400) · ab74f8f0
  Jinn authored Jun 20, 2025
  
  ab74f8f0
20 Jun, 2025 1 commit
- Purge VerlEngine (#7326) · 1ab6be1b
  Ata Fatahi authored Jun 19, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  1ab6be1b
10 Jun, 2025 1 commit
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
31 May, 2025 1 commit
- update llama4 chat template and pythonic parser (#6679) · 4fac524b
  Chao Yang authored May 30, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  4fac524b
30 May, 2025 1 commit
- Update DeepSeek-R1-0528 function call chat template (#6765) · 62cac2c4
  Xu Wenqing authored May 30, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  62cac2c4
29 May, 2025 1 commit
- Add DeepSeek-R1-0528 function call chat template (#6725) · f4d4f939
  Xu Wenqing authored May 29, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  f4d4f939
17 May, 2025 1 commit
- Use monotonic clock for interval measurement (#6211) · 3cf1473a
  Lifu Huang authored May 17, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  3cf1473a
13 May, 2025 1 commit
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
11 May, 2025 2 commits
- doc: fix the erroneous documents and example codes about... · 69276f61
  mlmz authored May 11, 2025
```
doc: fix the erroneous documents and example codes about Alibaba-NLP/gme-Qwen2-VL-2B-Instruct (#6199)
```
  69276f61
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
02 May, 2025 1 commit
- feat: Refactor DeepSeekV3 function call (#5908) · 170d1f21
  Chang Su authored May 01, 2025
  
  170d1f21
30 Apr, 2025 1 commit
- feat: support pythonic tool call and index in tool call streaming (#5725) · 2b06484b
  Chang Su authored Apr 29, 2025
  
  2b06484b
25 Apr, 2025 1 commit
- [Docs] Update runtime/engine/readme.md (#5737) · 269c457e
  Michael Yao authored Apr 26, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  269c457e
24 Apr, 2025 1 commit
- Add example to use sgl engine with fastapi (#5648) · d2b8d0b8
  Ravi Theja authored Apr 24, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  d2b8d0b8
21 Apr, 2025 3 commits
- [Feat.] Enable grafana to show metrics (#4718) · 57131dd9
  Huapeng Zhou authored Apr 21, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  57131dd9
- Correct grafana heatmap. (#5019) · 2b3bdc93
  mac0ne authored Apr 21, 2025
  
  2b3bdc93
- [Feature] Prefill assistant response - add continue_final_message parameter (#4226) · 8b39274e
  Adarsh Shirawalmath authored Apr 21, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  8b39274e
11 Apr, 2025 1 commit
- fix: examples for token_in_token_out_vlm (#5193) · e7beff8a
  XinyuanTong authored Apr 11, 2025
  
  e7beff8a
28 Mar, 2025 1 commit
- [CI] Remove unused imports with Ruff to pre-commit config, only to... · b149b393
  Brayden Zhong authored Mar 27, 2025
```
[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)
```
  b149b393
20 Mar, 2025 1 commit

Support `n` in OpenAI API completions (#3446) · fad86a68

Chuyue Sun authored Mar 19, 2025


Co-authored-by: Shan Yu <shanyu1@g.ucla.edu>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: chuyue sun <chuyue@lmsys.us-northcentral1-a.compute.internal>

fad86a68

14 Mar, 2025 1 commit
- feat(remote_model): support variable remote backend for model loader (#3964) · 1ce4878d
  wangyu authored Mar 14, 2025
```
Signed-off-by: wangyu <wangyu.steph@bytedance.com>
```
  1ce4878d
13 Mar, 2025 1 commit
- Fix the output of hidden states after HTTP requests (#4269) · 85d2365d
  Qiaolin Yu authored Mar 13, 2025
  
  85d2365d