Commits · 8b39274e3429c7813a5459d06b02cc032e8cb116 · change / sglang

21 Apr, 2025 1 commit
- [Feature] Prefill assistant response - add continue_final_message parameter (#4226) · 8b39274e
  Adarsh Shirawalmath authored Apr 21, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  8b39274e
16 Apr, 2025 1 commit
- Fix ignore_eos parameter when loading a chat template (#5264) · 27a009bb
  Chang Su authored Apr 15, 2025
  
  27a009bb
28 Mar, 2025 1 commit
- Include context length in /v1/models response. (#4809) · 04eb6062
  Jon Durbin authored Mar 27, 2025
  
  04eb6062
27 Mar, 2025 1 commit
- Align finish reason and stream mode in openai api (#4388) · 1afe3d07
  Xihuai Wang authored Mar 27, 2025
  
  1afe3d07
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
17 Mar, 2025 1 commit
- Constraint Decoding: Tool call with text (#4067) · 927ca935
  Xihuai Wang authored Mar 17, 2025
  
  927ca935
26 Jan, 2025 1 commit

Feature/function calling update (#2700) · b045841b

YAMY authored Jan 26, 2025


Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>

b045841b

10 Jan, 2025 1 commit
- [Bugfix] Fix embedding model hangs with `--enable-metrics` (#2822) · f290bd43
  Chang Su authored Jan 10, 2025
  
  f290bd43
29 Dec, 2024 1 commit

[Feature] Function Calling (#2544) · 8ee9a850

Tanjiro authored Dec 29, 2024


Co-authored-by: Haoyu Wang <120358163+HaoyuWang4188@users.noreply.github.com>

8ee9a850

26 Dec, 2024 1 commit
- [Feature] Support new parameter - EBNF in xgrammar (#2526) · acb34072
  Adarsh Shirawalmath authored Dec 26, 2024
  
  acb34072
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
12 Nov, 2024 1 commit
- support echo=true and logprobs in openai api when logprobs=1 in lm-evaluation-harness (#1998) · 027e6524
  Xiaoyu Zhang authored Nov 12, 2024
  
  027e6524
09 Nov, 2024 1 commit
- Clean up metrics code (#1972) · 9c939a3d
  Lianmin Zheng authored Nov 09, 2024
  
  9c939a3d
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
03 Nov, 2024 1 commit
- Simplify tokenizer manager (#1904) · c17c5781
  Lianmin Zheng authored Nov 03, 2024
  
  c17c5781
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
02 Oct, 2024 1 commit
- [Fix] Fix all the Huggingface paths (#1553) · 2c7d0a5b
  Theresa Barton authored Oct 02, 2024
  
  2c7d0a5b
22 Sep, 2024 1 commit
- [API, Feature] Support response prefill for openai API (#1490) · e4780cf8
  Ying Sheng authored Sep 22, 2024
  
  e4780cf8
15 Sep, 2024 1 commit
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097
27 Aug, 2024 1 commit
- [Minor] add delete test and delete tmp file on ci server (#1227) · 5ff25cdf
  yichuan~ authored Aug 26, 2024
  
  5ff25cdf
26 Aug, 2024 2 commits
- [FEAT] Support batches cancel (#1222) · 2f1d9283
  caiyueliang authored Aug 27, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  2f1d9283
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
20 Aug, 2024 1 commit
- feat: allow streaming for multi-prompt and/or parallel sampling (#1134) · d8476818
  Juwan Yoo authored Aug 20, 2024
  
  d8476818
19 Aug, 2024 1 commit

[Feat]Add support for optional start len of logprobs (#1035) · b997a18d

yichuan~ authored Aug 18, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

b997a18d

13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 1 commit
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
08 Aug, 2024 1 commit
- support more optioin about usage in stream mode (#985) · 3a79613c
  yichuan~ authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  3a79613c
07 Aug, 2024 3 commits
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
- misc: simplify test (#964) · 5f6fa04a
  yichuan~ authored Aug 07, 2024
  
  5f6fa04a
- Add support for Batch API test (#936) · 795eab6d
  yichuan~ authored Aug 07, 2024
  
  795eab6d
05 Aug, 2024 3 commits
- Fix prompt len in parallel sampling (#928) · fd7926e4
  yichuan~ authored Aug 05, 2024
  
  fd7926e4
- Test regex in vision api (#926) · 0a4f5f9b
  Ying Sheng authored Aug 04, 2024
  
  0a4f5f9b
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 4 commits
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
- Make API Key OpenAI-compatible (#917) · 0d4f3a9f
  Ying Sheng authored Aug 04, 2024
  
  0d4f3a9f
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
02 Aug, 2024 1 commit
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
01 Aug, 2024 1 commit
- Improve the coverage of the openai api server test (#878) · 60340a36
  Ying Sheng authored Aug 01, 2024
  
  60340a36