Commits · ca9291181df4b6a27c371eb71bf740263e5eb3ef · change / sglang

10 Jun, 2025 1 commit
- [Feature] Add Logit Bias (#6579) · ca929118
  Brayden Zhong authored Jun 10, 2025
```
Co-authored-by: Cinjon Resnick <cinjon.resnick@gmail.com>
```
  ca929118
13 May, 2025 1 commit
- Skip the flaky test_stateful_custom_logit_processor (#6251) · ac2324c1
  Lianmin Zheng authored May 12, 2025
  
  ac2324c1
12 May, 2025 1 commit
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

27 Jan, 2025 1 commit
- Add more logprob tests (#3162) · af02f99b
  Lianmin Zheng authored Jan 26, 2025
  
  af02f99b
26 Jan, 2025 1 commit
- Add a test case for cached_tokens (#3145) · d1a08632
  Lianmin Zheng authored Jan 26, 2025
  
  d1a08632
20 Jan, 2025 2 commits
- [Enhancement] Custom Logit Processor Improvement (#2998) · 583697cd
  Hongpeng Guo authored Jan 20, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  583697cd
- Skip flaky custom_logit_processor tests (#3004) · 51e87f6f
  Lianmin Zheng authored Jan 20, 2025
  
  51e87f6f
19 Jan, 2025 1 commit
- [Feature] Add sampler custom logits processor (#2396) · e403d237
  Hongpeng Guo authored Jan 19, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  e403d237
30 Dec, 2024 2 commits
- Minor follow-up fixes for the logprob refactor (#2670) · 21ec66e5
  Lianmin Zheng authored Dec 30, 2024
  
  21ec66e5
- Refactor logprob computation to return the real logprob used in sampling (#2664) · 9c6ba248
  Lianmin Zheng authored Dec 30, 2024
  
  9c6ba248
29 Nov, 2024 1 commit
- Simplify tokenizer manager (#2254) · fe97a2d4
  Lianmin Zheng authored Nov 29, 2024
  
  fe97a2d4
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
26 Nov, 2024 1 commit
- add sglang version to get_server_info (#2206) · 19f33b32
  Yudi Xue authored Nov 26, 2024
  
  19f33b32
25 Nov, 2024 1 commit
- [CI] Split test cases in CI for better load balancing (#2180) · 254fd130
  Lianmin Zheng authored Nov 25, 2024
  
  254fd130
24 Nov, 2024 2 commits
- Update CI threshold & Improve code style (#2159) · 5652c565
  Lianmin Zheng authored Nov 24, 2024
  
  5652c565
- Merged three native APIs into one: get_server_info (#2152) · dbe17293
  Henry Hyeonmok Ko authored Nov 24, 2024
  
  dbe17293
18 Nov, 2024 1 commit
- Fix chunked prefill with output logprob (#2083) · 80e2c4a8
  Lianmin Zheng authored Nov 18, 2024
  
  80e2c4a8
09 Nov, 2024 1 commit
- Clean up metrics code (#1972) · 9c939a3d
  Lianmin Zheng authored Nov 09, 2024
  
  9c939a3d
03 Nov, 2024 1 commit
- Simplify tokenizer manager (#1904) · c17c5781
  Lianmin Zheng authored Nov 03, 2024
  
  c17c5781
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
23 Oct, 2024 1 commit
- [API] add get memory pool size (#1760) · 2fce449b
  Ying Sheng authored Oct 23, 2024
```
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  2fce449b
15 Sep, 2024 1 commit
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097
26 Aug, 2024 1 commit
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
20 Aug, 2024 1 commit
- feat: allow streaming for multi-prompt and/or parallel sampling (#1134) · d8476818
  Juwan Yoo authored Aug 20, 2024
  
  d8476818
13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 1 commit
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
07 Aug, 2024 1 commit
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 1 commit
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
02 Aug, 2024 1 commit
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a