Commits · c6ec70290fbb5768100789a28f2521dc6ac0aa88 · zhaoyu6 / sglang

17 Mar, 2025 2 commits
- Constraint Decoding: Tool call with text (#4067) · 927ca935
  Xihuai Wang authored Mar 17, 2025
  
  927ca935
- Feature: support code completion (#3612) · 48efec7b
  woodx authored Mar 17, 2025
  
  48efec7b
13 Mar, 2025 4 commits
- Fix Llama3.3 tool call support (#4320) · 5fe79605
  Chang Su authored Mar 13, 2025
  
  5fe79605
- Ensure Usage Data in Streaming Responses Aligns with vLLM’s Implementation (#3814) · 40148041
  Wen Sun authored Mar 13, 2025
  
  40148041
- HotFix: json serialization error when using OAI v1/batches endpoint with logprobs (#3896) · f7f88b70
  David Carreto Fidalgo authored Mar 13, 2025
  
  f7f88b70
- Avoid duplicated request ids in batch APIs (#4026) · 6412c5e4
  Conghui Tan authored Mar 13, 2025
```
Co-authored-by: conghuitan <conghuitan@tencent.com>
```
  6412c5e4
07 Mar, 2025 1 commit
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8
04 Mar, 2025 1 commit
- Reasoning parser (#4000) · 95575aa7
  Xihuai Wang authored Mar 04, 2025
```
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
```
  95575aa7
03 Mar, 2025 1 commit
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
28 Feb, 2025 1 commit
- [Feature] integrate Structural Tag in xgrammar backend for function calling (#3566) · bac414ab
  mlmz authored Feb 28, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  bac414ab
24 Feb, 2025 1 commit
- Revert "Rename TokenizerManager to StdOrchestrator" (#3828) · f2388f6b
  Lianmin Zheng authored Feb 24, 2025
  
  f2388f6b
23 Feb, 2025 1 commit
- Improve: Rename TokenizerManager to StdOrchestrator (#3116) · 45360b2f
  fzyzcjy authored Feb 23, 2025
  
  45360b2f
21 Feb, 2025 1 commit
- [Fix] OpenAI API adapter tokenizer encoding (#3432) · c7c79b16
  Shi Shuai authored Feb 21, 2025
  
  c7c79b16
15 Feb, 2025 1 commit
- doc: emphasize and notify the usage of chat_template (#3589) · 7711ac6e
  Mick authored Feb 15, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  7711ac6e
26 Jan, 2025 1 commit

Feature/function calling update (#2700) · b045841b

YAMY authored Jan 26, 2025


Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>

b045841b

31 Dec, 2024 1 commit
- [Fix] fix openai adapter (#2685) · dc7eb01f
  Ying Sheng authored Dec 31, 2024
  
  dc7eb01f
29 Dec, 2024 1 commit

[Feature] Function Calling (#2544) · 8ee9a850

Tanjiro authored Dec 29, 2024


Co-authored-by: Haoyu Wang <120358163+HaoyuWang4188@users.noreply.github.com>

8ee9a850

26 Dec, 2024 1 commit
- [Feature] Support new parameter - EBNF in xgrammar (#2526) · acb34072
  Adarsh Shirawalmath authored Dec 26, 2024
  
  acb34072
22 Dec, 2024 1 commit
- Add lora_paths to v1_chat_generate_request (#2529) · 19ba2b0e
  Lei authored Dec 22, 2024
  
  19ba2b0e
17 Dec, 2024 1 commit
- Fix openai protocols and pass top_k, min_p (#2499) · 361ea8d9
  Lianmin Zheng authored Dec 17, 2024
  
  361ea8d9
01 Dec, 2024 1 commit
- Fix logprob for completions (#2301) · 5c18a037
  Lianmin Zheng authored Dec 01, 2024
  
  5c18a037
30 Nov, 2024 1 commit
- Support LoRA in Completion API (#2243) · 01017d4c
  bjmsong authored Nov 30, 2024
```
Co-authored-by: root <bjmsong@126.com>
```
  01017d4c
27 Nov, 2024 1 commit
- fix typo prompts (#2224) · a4fd2f9b
  Baoyuan Qi authored Nov 28, 2024
  
  a4fd2f9b
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
19 Nov, 2024 1 commit
- Fix: incorrect top_logprobs in chat completion (#2088) · 929c7621
  Alexander Waitz authored Nov 19, 2024
  
  929c7621
15 Nov, 2024 1 commit
- Expose no_stop_trim and skip_special_tokens in openai api (#2039) · ea53c63b
  Lianmin Zheng authored Nov 14, 2024
  
  ea53c63b
14 Nov, 2024 1 commit
- set content to empty string (#2026) · fb9fb351
  chottolabs authored Nov 13, 2024
  
  fb9fb351
12 Nov, 2024 2 commits
- fix a bug in v1_embeeding_request (#2014) · a1bd7190
  Xiaoyu Zhang authored Nov 12, 2024
  
  a1bd7190
- support echo=true and logprobs in openai api when logprobs=1 in lm-evaluation-harness (#1998) · 027e6524
  Xiaoyu Zhang authored Nov 12, 2024
  
  027e6524
03 Nov, 2024 1 commit
- Simplify tokenizer manager (#1904) · c17c5781
  Lianmin Zheng authored Nov 03, 2024
  
  c17c5781
17 Oct, 2024 2 commits
- Add matched_stop token or str to distinguish between eos or stop str... · a95d5589
  Gleb Drozdov authored Oct 17, 2024
```
Add matched_stop token or str to distinguish between eos or stop str finish_reason generation (#1684)
```
  a95d5589
- add orjson for jsonresponse (#1688) · b0facb33
  Michael Feil authored Oct 16, 2024
  
  b0facb33
16 Oct, 2024 1 commit
- Returning a per request metric for number of cached_tokens read (#1599) · ecb8bad2
  havetc authored Oct 16, 2024
  
  ecb8bad2
14 Oct, 2024 1 commit
- [Minor] Rename no_eos_trim to no_stop_trim (#1661) · 2725f8da
  Ying Sheng authored Oct 13, 2024
  
  2725f8da
13 Oct, 2024 1 commit
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
12 Oct, 2024 1 commit
- fix missing ignore_eos in v1/chat/completions (#1642) · 1d9deeac
  LI MOU authored Oct 12, 2024
  
  1d9deeac
11 Oct, 2024 2 commits
- Add image_token in conversation.py (#1632) · f13d86f9
  Lianmin Zheng authored Oct 11, 2024
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  f13d86f9
- [Bug] Fix the Image Input of Batch Generation (#1579) · b503881b
  Yiding-Lu authored Oct 11, 2024
  
  b503881b
22 Sep, 2024 1 commit
- [API, Feature] Support response prefill for openai API (#1490) · e4780cf8
  Ying Sheng authored Sep 22, 2024
  
  e4780cf8
15 Sep, 2024 1 commit
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097