Commits · f2388f6b9557e348732336a7a9afa14f167de33b · change / sglang

24 Feb, 2025 1 commit
- Revert "Rename TokenizerManager to StdOrchestrator" (#3828) · f2388f6b
  Lianmin Zheng authored Feb 24, 2025
  
  f2388f6b
23 Feb, 2025 1 commit
- Improve: Rename TokenizerManager to StdOrchestrator (#3116) · 45360b2f
  fzyzcjy authored Feb 23, 2025
  
  45360b2f
21 Feb, 2025 3 commits
- Docs: Update offline_engine_api and add links (#3773) · e3107222
  Chayenne authored Feb 21, 2025
  
  e3107222
- docs: Add offline engine launch example and documentation (#3771) · e074e76b
  Shi Shuai authored Feb 21, 2025
  
  e074e76b
- Docs: Fix layout to docs (#3733) · 4592afc2
  simveit authored Feb 21, 2025
  
  4592afc2
20 Feb, 2025 1 commit
- [Docs] Modify ep related server args and remove cublas part of deepseek (#3732) · ac053100
  Baizhou Zhang authored Feb 20, 2025
  
  ac053100
19 Feb, 2025 2 commits
- Docs: Fix layout with sub-section (#3710) · 3c7bfd7e
  Chayenne authored Feb 19, 2025
  
  3c7bfd7e
- [Docs]: Fix Multi-User Port Allocation Conflicts (#3601) · 55de40f7
  Shi Shuai authored Feb 19, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: simveit <simp.veitner@gmail.com>
```
  55de40f7
15 Feb, 2025 2 commits
- doc: emphasize and notify the usage of chat_template (#3589) · 7711ac6e
  Mick authored Feb 15, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  7711ac6e
- [CI] Improve Docs CI Efficiency (#3587) · 7443197a
  Shi Shuai authored Feb 15, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  7443197a
14 Feb, 2025 1 commit
- fix doc (#3558) · 31eec35b
  Yineng Zhang authored Feb 14, 2025
  
  31eec35b
11 Feb, 2025 1 commit
- fix server_arguments typo (#3499) · 1e2cf2b5
  Didier Durand authored Feb 11, 2025
  
  1e2cf2b5
10 Feb, 2025 1 commit
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
09 Feb, 2025 1 commit
- remove cutex dependency (#3422) · 4d2dbeac
  Yineng Zhang authored Feb 09, 2025
  
  4d2dbeac
04 Feb, 2025 1 commit
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
03 Feb, 2025 1 commit
- Update server args doc (#3273) · 7b5a3741
  simveit authored Feb 04, 2025
```
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
```
  7b5a3741
31 Jan, 2025 1 commit

Docs: Quick fix for Speculative_decoding doc (#3228) · 656f7fc1

Jhin authored Jan 31, 2025


Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>

656f7fc1

28 Jan, 2025 1 commit

Docs fix about EAGLE and streaming output (#3166) · 7b9b4f44

Jhin authored Jan 27, 2025


Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>

7b9b4f44

27 Jan, 2025 1 commit

Doc: Add Docs about EAGLE speculative decoding (#3144) · 9472e699

Jhin authored Jan 26, 2025


Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

9472e699

26 Jan, 2025 1 commit

Feature/function calling update (#2700) · b045841b

YAMY authored Jan 26, 2025


Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>

b045841b

23 Jan, 2025 1 commit

Docs: Update doc for server arguments (#2742) · 1c4e0d24

simveit authored Jan 23, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

1c4e0d24

20 Jan, 2025 1 commit
- Docs: Only use X-Grammar in structed output (#2991) · 0ffcfdf4
  Chayenne authored Jan 19, 2025
  
  0ffcfdf4
19 Jan, 2025 1 commit
- support regex in xgrammar backend (#2983) · 3bcf5ece
  Enrique Shockwave authored Jan 19, 2025
  
  3bcf5ece
16 Jan, 2025 1 commit
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
11 Jan, 2025 1 commit
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e
08 Jan, 2025 2 commits
- Docs：Update the style of llma 3.1 405B docs (#2789) · 2e6346fc
  Chayenne authored Jan 08, 2025
  
  2e6346fc
- Docs: Rewrite docs for LLama 405B and ModelSpace (#2773) · 977f785d
  mlmz authored Jan 08, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  977f785d
01 Jan, 2025 1 commit
- [Docs] Add Support for Pydantic Structured Output Format (#2697) · 062c48d2
  Shi Shuai authored Jan 01, 2025
  
  062c48d2
31 Dec, 2024 1 commit
- Docs: Refactor Contribution Guide (#2690) · 0a765bbc
  Shi Shuai authored Dec 31, 2024
  
  0a765bbc
30 Dec, 2024 2 commits
- Update structured_outputs.ipynb (#2666) · bdd2827a
  Lianmin Zheng authored Dec 30, 2024
  
  bdd2827a
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
29 Dec, 2024 2 commits
- [Docs] Add EBNF to sampling params docs (#2609) · fd34f2da
  Adarsh Shirawalmath authored Dec 29, 2024
  
  fd34f2da
- [Feature] Function Calling (#2544) · 8ee9a850
  Tanjiro authored Dec 29, 2024
```
Co-authored-by: Haoyu Wang <120358163+HaoyuWang4188@users.noreply.github.com>
```
  8ee9a850
28 Dec, 2024 2 commits
- [docs]Refactor constrained decoding tutorial (#2633) · 333e3bfd
  Shi Shuai authored Dec 28, 2024
  
  333e3bfd
- Docs: Add constrained decoding tutorial (#2614) · 239c9d4d
  Shi Shuai authored Dec 28, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  239c9d4d
26 Dec, 2024 1 commit

Fix logprob_start_len for multi modal models (#2597) · 77395154

Lianmin Zheng authored Dec 26, 2024


Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>

77395154

23 Dec, 2024 1 commit
- Doc: Update Grammar Backend (#2545) · 25e5d589
  Shi Shuai authored Dec 23, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  25e5d589
04 Dec, 2024 1 commit
- Fix Docs CI When Compile Error (#2323) · 786be44d
  Chayenne authored Dec 04, 2024
  
  786be44d
30 Nov, 2024 1 commit
- udate weights from disk (#2265) · 7d5d1d3d
  Chayenne authored Nov 29, 2024
  
  7d5d1d3d
29 Nov, 2024 1 commit
- Update backend.md (#2251) · 4f2ee48e
  Lianmin Zheng authored Nov 28, 2024
  
  4f2ee48e