Commits · 0d800090b4effc3f683054ba411cc62521f6ddb4 · change / sglang

"docs/source/en/_toctree.yml" did not exist on "2579d42158927171464f248ff69a523b0dfbf2f8"

23 Oct, 2024 8 commits
- Fix missing additional_stop_token_ids (#1769) · 0d800090
  Lianmin Zheng authored Oct 23, 2024
  
  0d800090
- Update docs (#1768) · b7d05594
  Lianmin Zheng authored Oct 23, 2024
```
Co-authored-by: Chayenne Zhao <zhaochenyang20@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  b7d05594
- Fix stop condition for <|eom_id|> (#1766) · 80a90547
  Lianmin Zheng authored Oct 23, 2024
  
  80a90547
- [Fix] Fix abort in dp (#1767) · 9af7b88e
  Lianmin Zheng authored Oct 23, 2024
  
  9af7b88e
- Fix perf regression for set_kv_buffer (#1765) · fbcbb263
  Lianmin Zheng authored Oct 23, 2024
  
  fbcbb263
- [API] add get memory pool size (#1760) · 2fce449b
  Ying Sheng authored Oct 23, 2024
```
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  2fce449b
- Fuse more ops & Simplify token mapping (#1758) · ad4125d1
  Lianmin Zheng authored Oct 22, 2024
  
  ad4125d1
- Fix edge case for truncated (#1747) · 17536e7e
  Byron Hsu authored Oct 22, 2024
  
  17536e7e
22 Oct, 2024 1 commit
- Release v0.3.4.post1 (#1749) · 1f26e8b8
  Lianmin Zheng authored Oct 21, 2024
  
  1f26e8b8
21 Oct, 2024 11 commits
- Update `max_req_len` and `max_req_input_len` (#1748) · 5e1558f1
  Liangsheng Yin authored Oct 21, 2024
  
  5e1558f1
- Llama3.2 vision model support (#1551) · 94cde109
  Liangsheng Yin authored Oct 21, 2024
  
  94cde109
- Fix sliding window attention and gemma-2 unit tests in CI (#1746) · 00611286
  Lianmin Zheng authored Oct 21, 2024
  
  00611286
- misc: add CODEOWNERS (#1737) · e68b9e76
  Yineng Zhang authored Oct 21, 2024
  
  e68b9e76
- Faster overlap mode scheduler (#1738) · 7ce36068
  Lianmin Zheng authored Oct 21, 2024
  
  7ce36068
- Fix prefill oom (#1743) · efb099cd
  Liangsheng Yin authored Oct 21, 2024
  
  efb099cd
- Maintain seq_lens_sum to make more FlashInfer operations non-blocking (#1741) · 09603c6d
  Lianmin Zheng authored Oct 21, 2024
  
  09603c6d
- Make token mapping non-blocking in the overlapped mode (#1740) · cf470fea
  Lianmin Zheng authored Oct 20, 2024
  
  cf470fea
- Add GLM-4 TextGeneration Model support for SGLang (#1736) · 45d5af24
  sixgod authored Oct 21, 2024
  
  45d5af24
- Simplify batch result resolution (#1735) · b121bc03
  Lianmin Zheng authored Oct 20, 2024
  
  b121bc03
- Simplify the usage of device (#1734) · e12358dc
  Lianmin Zheng authored Oct 20, 2024
  
  e12358dc
20 Oct, 2024 9 commits
- [Bugfix] qwen2vl forward_extend (#1727) · 554fbf93
  yizhang2077 authored Oct 20, 2024
  
  554fbf93
- Split the overlapped version of TpModelWorkerClient into a separate file (#1726) · b48edff6
  Lianmin Zheng authored Oct 20, 2024
  
  b48edff6
- Temporarily skip this test_mixed_batch for QWen2VL (#1725) · 593b19f2
  Lianmin Zheng authored Oct 20, 2024
  
  593b19f2
- Unify the memory pool api and tp worker API (#1724) · 59cbf476
  Lianmin Zheng authored Oct 19, 2024
  
  59cbf476
- Update README.md · 95946271
  Ying Sheng authored Oct 19, 2024
  
  95946271
- Update README.md (#1722) · 5c4ce656
  Ying Sheng authored Oct 19, 2024
  
  5c4ce656
- Support qwen2 vl model (#1721) · cbbc82b7
  Yineng Zhang authored Oct 19, 2024
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ispobock <ISPObaoke@163.com>
```
  cbbc82b7
- Update vllm to 0.6.3 (#1711) (#1720) · 8bee20f8
  Yineng Zhang authored Oct 19, 2024
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  8bee20f8
- Simplify the interface of tp_worker (#1718) · 12cad0fe
  Lianmin Zheng authored Oct 19, 2024
  
  12cad0fe
19 Oct, 2024 7 commits
- Update readme and workflow (#1716) · b6cd9036
  Lianmin Zheng authored Oct 19, 2024
  
  b6cd9036
- Release v0.3.4 (#1714) · 087257ea
  Lianmin Zheng authored Oct 19, 2024
  
  087257ea
- Update README.md (#1713) · 736f0402
  Lianmin Zheng authored Oct 19, 2024
  
  736f0402
- Fix the race condition in overlap mode (#1712) · 769bf11c
  Lianmin Zheng authored Oct 19, 2024
  
  769bf11c
- Fix `is_all_ready` for overlap copy (#1710) · 3db43d1b
  Lianmin Zheng authored Oct 18, 2024
  
  3db43d1b
- Simplify the nan detection and greedy check in sampler (#1709) · f0f8a769
  Lianmin Zheng authored Oct 18, 2024
  
  f0f8a769
- Skip unnecessary penalizer (#1707) · 2bcfba1b
  Lianmin Zheng authored Oct 18, 2024
  
  2bcfba1b
18 Oct, 2024 4 commits
- Add grouped free operations (#1706) · bc12d403
  Lianmin Zheng authored Oct 18, 2024
  
  bc12d403
- Add dtype for more operations (#1705) · 392f2863
  Lianmin Zheng authored Oct 18, 2024
  
  392f2863
- Simplify flashinfer utilities (#1704) · 6d0fa73e
  Lianmin Zheng authored Oct 17, 2024
  
  6d0fa73e
- Fix regex and logprob conflicts when chunked prefilling (#1703) · 9e0dac1a
  Liangsheng Yin authored Oct 17, 2024
  
  9e0dac1a