Commits · 4093aa4660838c42a51f860989450b7d4c480436 · zhaoyu6 / sglang

"tests/generation/test_generation_stopping_criteria.py" did not exist on "fecb08c2b8d8003f19147c8c6f5ad6d4df23c710"

11 Jan, 2025 1 commit
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e
07 Jan, 2025 1 commit
- Misc fix for min_p_sampling, --cuda-graph-bs (#2761) · bdc1acf6
  Lianmin Zheng authored Jan 07, 2025
  
  bdc1acf6
06 Jan, 2025 1 commit
- Clean up eagle code (#2756) · b8574f69
  Lianmin Zheng authored Jan 06, 2025
  
  b8574f69
03 Jan, 2025 1 commit
- Fix package loss for small models (#2717) · 0f9cc6d8
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: sdli1995 < mmlmonkey@163.com>
```
  0f9cc6d8
02 Jan, 2025 1 commit
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
30 Dec, 2024 1 commit
- Refactor logprob computation to return the real logprob used in sampling (#2664) · 9c6ba248
  Lianmin Zheng authored Dec 30, 2024
  
  9c6ba248
29 Dec, 2024 3 commits
- [Feature] Get Token IDs with Engine.generate() (#2636) · 35bdb485
  Shi Shuai authored Dec 29, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  35bdb485
- [Session] Update session control interface (#2635) · e0e09fce
  Ying Sheng authored Dec 29, 2024
  
  e0e09fce
- Clean up wrapper in flashinfer backend (#2638) · 3815b23c
  Lianmin Zheng authored Dec 29, 2024
  
  3815b23c
28 Dec, 2024 1 commit
- Add `update_weights_from_tensor` (#2631) · fd28640d
  fzyzcjy authored Dec 29, 2024
  
  fd28640d
27 Dec, 2024 2 commits
- [minor] clean up docs and eos id (#2622) · 751e5ca2
  Lianmin Zheng authored Dec 27, 2024
  
  751e5ca2
- [FIX] Update EOS from config (#2475) · 7a7ac6be
  Yang Zheng authored Dec 28, 2024
  
  7a7ac6be
26 Dec, 2024 4 commits
- Fix duplicated handling of GetWeightsByNameReqInput (#2565) · 3169e66c
  fzyzcjy authored Dec 26, 2024
  
  3169e66c
- Fix logprob_start_len for multi modal models (#2597) · 77395154
  Lianmin Zheng authored Dec 26, 2024
```
Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>
```
  77395154
- [Feature] Support new parameter - EBNF in xgrammar (#2526) · acb34072
  Adarsh Shirawalmath authored Dec 26, 2024
  
  acb34072
- Fix cache hit rate when chunked prefill (#2555) · e7ebecf8
  Liangsheng Yin authored Dec 26, 2024
  
  e7ebecf8
22 Dec, 2024 1 commit
- [Misc] Fix metrics, weight update lock, request logging (#2543) · 84967019
  Lianmin Zheng authored Dec 22, 2024
  
  84967019
11 Dec, 2024 1 commit
- [Core] in batch prefix caching by delay scheduling (#2442) · 9208618b
  SangBin Cho authored Dec 11, 2024
  
  9208618b
09 Dec, 2024 1 commit
- [Minor] Improve code style (#2419) · 0ce091a8
  Lianmin Zheng authored Dec 09, 2024
  
  0ce091a8
08 Dec, 2024 4 commits
- Simplify stream_output (#2398) · a6ca736c
  Lianmin Zheng authored Dec 08, 2024
  
  a6ca736c
- Fix recv_requests (#2405) · cc858953
  Lianmin Zheng authored Dec 08, 2024
  
  cc858953
- Fix a bug with logprob streaming + chunked prefill (#2403) · a2486eb5
  Lianmin Zheng authored Dec 08, 2024
  
  a2486eb5
- nit: Remove busy waiting on scheduler (#2382) · 1f09e84b
  SangBin Cho authored Dec 08, 2024
  
  1f09e84b
06 Dec, 2024 2 commits
- Fix the overlap for xgrammar (#2377) · 0e7409ad
  Lianmin Zheng authored Dec 06, 2024
  
  0e7409ad
- Add more support for intel Gaudi accelerators (#2357) · 37ee906f
  Qun Yang authored Dec 06, 2024
  
  37ee906f
02 Dec, 2024 3 commits
- Update model_loader deps and qqq quantization deps (#2220) (#2318) · 85e1a6f3
  Yineng Zhang authored Dec 02, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  85e1a6f3
- [Fix] Fix the padded hash value for image tokens (#2309) · 3c79ad35
  Lianmin Zheng authored Dec 01, 2024
  
  3c79ad35
- Online weight updates from torch.distributed (#2279) · 983bfcf3
  Chayenne authored Dec 01, 2024
  
  983bfcf3
01 Dec, 2024 1 commit
- Fix chunked prefill when ignore eos (#2290) · 5f12f0e7
  Liangsheng Yin authored Dec 01, 2024
  
  5f12f0e7
30 Nov, 2024 3 commits
- Add get weights by parameter name for llama (#2266) · 7d1485d3
  Chayenne authored Nov 29, 2024
  
  7d1485d3
- udate weights from disk (#2265) · 7d5d1d3d
  Chayenne authored Nov 29, 2024
  
  7d5d1d3d
- Fix the default chunked prefill size (#2268) · 94e167ea
  Lianmin Zheng authored Nov 29, 2024
  
  94e167ea
29 Nov, 2024 3 commits
- [Minor] fix the style for multimodal models (#2257) · afe1e465
  Lianmin Zheng authored Nov 29, 2024
  
  afe1e465
- Fix hash collision for multi modal models (#2256) · f50a6cf4
  Lianmin Zheng authored Nov 29, 2024
  
  f50a6cf4
- Simplify tokenizer manager (#2254) · fe97a2d4
  Lianmin Zheng authored Nov 29, 2024
  
  fe97a2d4
28 Nov, 2024 3 commits
- Fix memory leak during abort (#2238) · b2ccf36d
  Lianmin Zheng authored Nov 28, 2024
  
  b2ccf36d
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
- Disable overlap scheduler for multimodal models (#2235) · fb915bd1
  Lianmin Zheng authored Nov 27, 2024
  
  fb915bd1
27 Nov, 2024 2 commits
- Rename DP_RANK to SGLANG_DP_RANK (#2218) · 2a02185c
  Lianmin Zheng authored Nov 27, 2024
  
  2a02185c
- Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default (#2222) · fb6e04a0
  Lianmin Zheng authored Nov 27, 2024
  
  fb6e04a0