Commits · dbb16bedd54ffc2d7d2a2eac8d8064711f0c7286 · change / sglang

21 Oct, 2025 1 commit
- Support Thinking Budget (via custom_logit_processor for OpenAI API) [Fix #6572] (#11416) · dbb16bed
  ybyang authored Oct 21, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: YorkSu <york_su@qq.com>
```
  dbb16bed
05 Oct, 2025 1 commit
- Update `v1/responses` to be more OpenAI-compatible. (#9624) · 36a6b8db
  Vincent Zhong authored Oct 05, 2025
  
  36a6b8db
03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
27 Jul, 2025 1 commit
- bugfix: Fix multiple finish_reason chunks and tool_calls finish reason check (#8417) · b47eda33
  Chang Su authored Jul 27, 2025
  
  b47eda33
22 Jun, 2025 1 commit
- refactor(test): reorganize OpenAI test file structure (#7408) · b7a2df0a
  Chang Su authored Jun 21, 2025
  
  b7a2df0a
21 Jun, 2025 1 commit
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
16 Jun, 2025 1 commit
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
10 Jun, 2025 1 commit
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
04 Jun, 2025 1 commit
- Decoder-only Scoring API (#6460) · 3f1e4339
  Chanh Nguyen authored Jun 04, 2025
```
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
```
  3f1e4339
20 May, 2025 1 commit
- Revert "Implement `return_hidden_states` for the OpenAI API (#6137)" (#6440) · b1465557
  Yineng Zhang authored May 19, 2025
  
  b1465557
19 May, 2025 1 commit
- Implement `return_hidden_states` for the OpenAI API (#6137) · 4f39bcf7
  kyle-pena-kuzco authored May 19, 2025
  
  4f39bcf7
11 May, 2025 2 commits
- Handle empty input string for embedding models (#5621) · 41a645f5
  Ravi Theja authored May 11, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  41a645f5
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
21 Apr, 2025 1 commit
- [Feature] Prefill assistant response - add continue_final_message parameter (#4226) · 8b39274e
  Adarsh Shirawalmath authored Apr 21, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  8b39274e
16 Apr, 2025 1 commit
- Fix ignore_eos parameter when loading a chat template (#5264) · 27a009bb
  Chang Su authored Apr 15, 2025
  
  27a009bb
28 Mar, 2025 1 commit
- Include context length in /v1/models response. (#4809) · 04eb6062
  Jon Durbin authored Mar 27, 2025
  
  04eb6062
27 Mar, 2025 1 commit
- Align finish reason and stream mode in openai api (#4388) · 1afe3d07
  Xihuai Wang authored Mar 27, 2025
  
  1afe3d07
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
17 Mar, 2025 1 commit
- Constraint Decoding: Tool call with text (#4067) · 927ca935
  Xihuai Wang authored Mar 17, 2025
  
  927ca935
26 Jan, 2025 1 commit

Feature/function calling update (#2700) · b045841b

YAMY authored Jan 26, 2025


Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>

b045841b

10 Jan, 2025 1 commit
- [Bugfix] Fix embedding model hangs with `--enable-metrics` (#2822) · f290bd43
  Chang Su authored Jan 10, 2025
  
  f290bd43
29 Dec, 2024 1 commit

[Feature] Function Calling (#2544) · 8ee9a850

Tanjiro authored Dec 29, 2024


Co-authored-by: Haoyu Wang <120358163+HaoyuWang4188@users.noreply.github.com>

8ee9a850

26 Dec, 2024 1 commit
- [Feature] Support new parameter - EBNF in xgrammar (#2526) · acb34072
  Adarsh Shirawalmath authored Dec 26, 2024
  
  acb34072
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
12 Nov, 2024 1 commit
- support echo=true and logprobs in openai api when logprobs=1 in lm-evaluation-harness (#1998) · 027e6524
  Xiaoyu Zhang authored Nov 12, 2024
  
  027e6524
09 Nov, 2024 1 commit
- Clean up metrics code (#1972) · 9c939a3d
  Lianmin Zheng authored Nov 09, 2024
  
  9c939a3d
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
03 Nov, 2024 1 commit
- Simplify tokenizer manager (#1904) · c17c5781
  Lianmin Zheng authored Nov 03, 2024
  
  c17c5781
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
02 Oct, 2024 1 commit
- [Fix] Fix all the Huggingface paths (#1553) · 2c7d0a5b
  Theresa Barton authored Oct 02, 2024
  
  2c7d0a5b
22 Sep, 2024 1 commit
- [API, Feature] Support response prefill for openai API (#1490) · e4780cf8
  Ying Sheng authored Sep 22, 2024
  
  e4780cf8
15 Sep, 2024 1 commit
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097
27 Aug, 2024 1 commit
- [Minor] add delete test and delete tmp file on ci server (#1227) · 5ff25cdf
  yichuan~ authored Aug 26, 2024
  
  5ff25cdf
26 Aug, 2024 2 commits
- [FEAT] Support batches cancel (#1222) · 2f1d9283
  caiyueliang authored Aug 27, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  2f1d9283
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
20 Aug, 2024 1 commit
- feat: allow streaming for multi-prompt and/or parallel sampling (#1134) · d8476818
  Juwan Yoo authored Aug 20, 2024
  
  d8476818
19 Aug, 2024 1 commit

[Feat]Add support for optional start len of logprobs (#1035) · b997a18d

yichuan~ authored Aug 18, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

b997a18d

13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 1 commit
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370