Commits · 95575aa76a0716aa018ac2359dc63b934f94ff51 · change / sglang

04 Mar, 2025 1 commit
- Reasoning parser (#4000) · 95575aa7
  Xihuai Wang authored Mar 04, 2025
```
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
```
  95575aa7
28 Feb, 2025 1 commit
- [Feature] integrate Structural Tag in xgrammar backend for function calling (#3566) · bac414ab
  mlmz authored Feb 28, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  bac414ab
26 Jan, 2025 1 commit

Feature/function calling update (#2700) · b045841b

YAMY authored Jan 26, 2025


Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>

b045841b

16 Jan, 2025 1 commit
- Improve type annotation and styles (#2926) · bc6915e3
  Lianmin Zheng authored Jan 16, 2025
  
  bc6915e3
30 Dec, 2024 1 commit
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
29 Dec, 2024 1 commit

[Feature] Function Calling (#2544) · 8ee9a850

Tanjiro authored Dec 29, 2024


Co-authored-by: Haoyu Wang <120358163+HaoyuWang4188@users.noreply.github.com>

8ee9a850

26 Dec, 2024 1 commit
- [Feature] Support new parameter - EBNF in xgrammar (#2526) · acb34072
  Adarsh Shirawalmath authored Dec 26, 2024
  
  acb34072
17 Dec, 2024 2 commits
- Fix openai protocols and pass top_k, min_p (#2499) · 361ea8d9
  Lianmin Zheng authored Dec 17, 2024
  
  361ea8d9
- Add lora_path to chat completion (#2438) · 33c5ff28
  Lei authored Dec 17, 2024
  
  33c5ff28
30 Nov, 2024 1 commit
- Support LoRA in Completion API (#2243) · 01017d4c
  bjmsong authored Nov 30, 2024
```
Co-authored-by: root <bjmsong@126.com>
```
  01017d4c
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
18 Nov, 2024 1 commit
- support set role as 'tool' (#2075) · 2a3992b6
  yukavio authored Nov 18, 2024
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  2a3992b6
15 Nov, 2024 1 commit
- Expose no_stop_trim and skip_special_tokens in openai api (#2039) · ea53c63b
  Lianmin Zheng authored Nov 14, 2024
  
  ea53c63b
17 Oct, 2024 1 commit
- Add matched_stop token or str to distinguish between eos or stop str... · a95d5589
  Gleb Drozdov authored Oct 17, 2024
```
Add matched_stop token or str to distinguish between eos or stop str finish_reason generation (#1684)
```
  a95d5589
16 Oct, 2024 1 commit
- Returning a per request metric for number of cached_tokens read (#1599) · ecb8bad2
  havetc authored Oct 16, 2024
  
  ecb8bad2
14 Oct, 2024 1 commit
- [Minor] Rename no_eos_trim to no_stop_trim (#1661) · 2725f8da
  Ying Sheng authored Oct 13, 2024
  
  2725f8da
13 Oct, 2024 1 commit
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
12 Oct, 2024 1 commit
- Fix ignore_eos (#1645) · e37cdab0
  Lianmin Zheng authored Oct 12, 2024
  
  e37cdab0
10 Sep, 2024 1 commit
- Support OpenAI API json_schema response format (#1363) · 9144ed10
  zifeitong authored Sep 09, 2024
  
  9144ed10
09 Sep, 2024 1 commit
- [Feat] Add modalities for vision server when handling pixel values for llava (#1346) · 662ecd93
  Kaichen Zhang - NTU authored Sep 09, 2024
  
  662ecd93
30 Aug, 2024 1 commit
- Allow more flexible assistant and system response (#1256) · 51c554d8
  Christopher Chou authored Aug 30, 2024
  
  51c554d8
26 Aug, 2024 1 commit
- [FEAT] JSON constrained support (#1125) · 9935f97b
  havetc authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  9935f97b
09 Aug, 2024 1 commit
- Add openai embedding API (#997) · b16e856f
  Ying Sheng authored Aug 09, 2024
  
  b16e856f
08 Aug, 2024 3 commits
- feat: frequency, min_new_tokens, presence, and repetition penalties (#973) · ab787594
  Juwan Yoo authored Aug 08, 2024
  
  ab787594
- support more optioin about usage in stream mode (#985) · 3a79613c
  yichuan~ authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  3a79613c
- Add io struct for embedding models [unreachable code] - step 2/3 (#987) · 20a4f927
  Ying Sheng authored Aug 08, 2024
  
  20a4f927
07 Aug, 2024 1 commit
- Add support for Batch API test (#936) · 795eab6d
  yichuan~ authored Aug 07, 2024
  
  795eab6d
04 Aug, 2024 1 commit
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
01 Aug, 2024 1 commit
- Add support for logprobs in OpenAI chat API (#852) · ca600e8c
  yichuan~ authored Aug 01, 2024
  
  ca600e8c
29 Jul, 2024 1 commit
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d
28 Jul, 2024 1 commit
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
27 Jul, 2024 1 commit
- Fix max_tokens for OpenAI chat completion API (#766) · f95e6617
  Lianmin Zheng authored Jul 27, 2024
  
  f95e6617
20 Jul, 2024 1 commit
- Update OpenAI API (#667) · e3046ea3
  Mingyi authored Jul 19, 2024
  
  e3046ea3
19 Jul, 2024 1 commit
- feat: add benchmark serving (#657) · c126a6cc
  zhyncs authored Jul 20, 2024
  
  c126a6cc
09 Jul, 2024 1 commit
- Fix the default argument of OpenAI Chat completion (#605) · da2e5d65
  Lianmin Zheng authored Jul 09, 2024
  
  da2e5d65
08 Jun, 2024 1 commit
- Improve doc strings (#518) · f6dbd240
  Lianmin Zheng authored Jun 08, 2024
  
  f6dbd240
21 May, 2024 1 commit
- Abort disconnected requests (#457) · 8dbdc018
  Lianmin Zheng authored May 20, 2024
  
  8dbdc018
14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
12 May, 2024 2 commits
- Move openai api server into a separate file (#429) · 3fc97f67
  Lianmin Zheng authored May 12, 2024
  
  3fc97f67
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523