Commits · da1ffed689f2e18702b152d3d86ed5312e86f33a · change / sglang · GitLab

14 Oct, 2024 1 commit
- Add output_ids into ScheduleBatch (#1659) · da1ffed6
  Lianmin Zheng authored Oct 13, 2024
  
  da1ffed6
13 Oct, 2024 6 commits
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
- [doc] Add engine section in backend.md (#1656) · c3f2fc5a
  Byron Hsu authored Oct 13, 2024
  
  c3f2fc5a
- Simplify the event loop and expose `--num-continuous-decode-steps` as an argument (#1652) · 7ee6c259
  Lianmin Zheng authored Oct 12, 2024
  
  7ee6c259
- Fix the batch_is_full check for jump-forward decoding (#1654) · 9610fcd4
  Lianmin Zheng authored Oct 12, 2024
  
  9610fcd4
- Add get_tokenizer function for Engine class (#1653) · 31fad29a
  Patrick Yi authored Oct 12, 2024
  
  31fad29a
- Add an option to disable penalizer (#1651) · 9da5a60b
  Lianmin Zheng authored Oct 12, 2024
  
  9da5a60b
12 Oct, 2024 4 commits
- Fix unit tests and type annotations (#1648) · 69aa937a
  Lianmin Zheng authored Oct 12, 2024
  
  69aa937a
- [Feature, Hardware] Enable SGLang on XPU GPUs via PyTorch (#1480) · 5d638c92
  Zhang, Liangang authored Oct 13, 2024
  
  5d638c92
- Fix ignore_eos (#1645) · e37cdab0
  Lianmin Zheng authored Oct 12, 2024
  
  e37cdab0
- fix missing ignore_eos in v1/chat/completions (#1642) · 1d9deeac
  LI MOU authored Oct 12, 2024
  
  1d9deeac
11 Oct, 2024 16 commits
- [Fix] Fix the style of test_large_max_new_tokens.py (#1638) · dafb6a52
  Lianmin Zheng authored Oct 11, 2024
  
  dafb6a52
- [engine] support async and streaming (#1614) · 862cd265
  Byron Hsu authored Oct 11, 2024
  
  862cd265
- Release v0.3.3.post1 (#1636) · 00c7e636
  Lianmin Zheng authored Oct 11, 2024
  
  00c7e636
- Add back data parallelism (#1635) · 23cc66f7
  Lianmin Zheng authored Oct 11, 2024
  
  23cc66f7
- Fix constrained decoding (#1634) · 5d09ca57
  Lianmin Zheng authored Oct 11, 2024
  
  5d09ca57
- Added a "Back To Top" Button (#1633) · 81c33274
  Janumala Akhilendra authored Oct 11, 2024
  
  81c33274
- Add image_token in conversation.py (#1632) · f13d86f9
  Lianmin Zheng authored Oct 11, 2024
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  f13d86f9
- Fix the correctness test in bench_latency.py when tp > 1 and test_generation_models.py (#1631) · aba9eae4
  Lianmin Zheng authored Oct 11, 2024
  
  aba9eae4
- Add the ability to enable and disable the Profiler via HTTP API. (#1626) · bbd72bfc
  科英 authored Oct 11, 2024
  
  bbd72bfc
- [Bug] Fix the Image Input of Batch Generation (#1579) · b503881b
  Yiding-Lu authored Oct 11, 2024
  
  b503881b
- Nit about the decorator of `PortArgs.init_new` (#1611) · 58093b86
  glen-amd authored Oct 11, 2024
  
  58093b86
- Add device support (#1607) · 8275049c
  Zhang, Liangang authored Oct 11, 2024
  
  8275049c
- Update README.md · 5476ccad
  Lianmin Zheng authored Oct 11, 2024
  
  5476ccad
- Update README.md (#1629) · b040ed71
  Lianmin Zheng authored Oct 11, 2024
  
  b040ed71
- Update README.md (#1625) · c9e66586
  Kushal Agrawal authored Oct 11, 2024
  
  c9e66586
- [Performance, hardware] MoE tuning update to AMD MI300x GPUs (#1619) · e11ab79e
  HAI authored Oct 10, 2024
  
  e11ab79e
10 Oct, 2024 1 commit
- Fix test_vision_openai_server on CI (#1620) · 01fdb2f3
  Byron Hsu authored Oct 10, 2024
  
  01fdb2f3
09 Oct, 2024 1 commit
- [Minor] Fix logging typo (#1615) · c996e8cc
  Amos You authored Oct 08, 2024
  
  c996e8cc
08 Oct, 2024 2 commits
- Release v0.3.3 (#1605) · 7b69d91b
  Lianmin Zheng authored Oct 08, 2024
  
  7b69d91b
- [Engine] Fix generate hanging issue after the first call (#1606) · e8613df0
  Byron Hsu authored Oct 07, 2024
  
  e8613df0
07 Oct, 2024 9 commits
- [Profile] Add pytorch profiler (#1604) · c5325aba
  Ying Sheng authored Oct 07, 2024
  
  c5325aba
- Optimize broadcast & Reorg code (#1598) · ebbc42d9
  Lianmin Zheng authored Oct 07, 2024
  
  ebbc42d9
- Remove references to squeezellm (#1603) · 3ff64113
  Jani Monoses authored Oct 07, 2024
  
  3ff64113
- Fix the port_args in bench_latency (#1597) · 2b302b93
  Lianmin Zheng authored Oct 07, 2024
  
  2b302b93
- Fix chunked prefill condition (#1594) · 68f8b60d
  Ke Bao authored Oct 07, 2024
  
  68f8b60d
- Use is_flashinfer_available to replace is_hip for flashinfer check (#1596) · 6a5b352a
  Lianmin Zheng authored Oct 06, 2024
```
Co-authored-by: Zhang Liangang <liangang.zhang@intel.com>
```
  6a5b352a
- Use `atexit` hook to implicitly shutdown `Runtime` (#1595) · 565b05f0
  Byron Hsu authored Oct 06, 2024
  
  565b05f0
- [Fix] Fix the case where prompt_len = 0 (#1593) · b6aad70a
  Lianmin Zheng authored Oct 06, 2024
  
  b6aad70a
- Provide an offline engine API (#1567) · 551a3a9d
  Byron Hsu authored Oct 06, 2024
  
  551a3a9d