Commits · 24f3e1511cc289b1b7e3e94e4ee19ab559a5e7f9 · change / sglang

"megatron/legacy/model/module.py" did not exist on "051f58f1a5a8a7450ffea5c3aadaa2ea4b3a8630"

14 Oct, 2024 7 commits
- [Minor] Improve style (#1666) · 24f3e151
  Lianmin Zheng authored Oct 14, 2024
  
  24f3e151
- Fix unit test order to balance the tasks in CI (#1665) · 6790240c
  Lianmin Zheng authored Oct 14, 2024
  
  6790240c
- Support double sparsity (#1459) · 061e5463
  Shuo Yang authored Oct 14, 2024
  
  061e5463
- Move filter_batch out of stream_output (#1663) · 0c1e8796
  Lianmin Zheng authored Oct 14, 2024
  
  0c1e8796
- Add a test case to test retract (#1662) · 869f1c02
  Lianmin Zheng authored Oct 13, 2024
  
  869f1c02
- [Minor] Rename no_eos_trim to no_stop_trim (#1661) · 2725f8da
  Ying Sheng authored Oct 13, 2024
  
  2725f8da
- Add output_ids into ScheduleBatch (#1659) · da1ffed6
  Lianmin Zheng authored Oct 13, 2024
  
  da1ffed6
13 Oct, 2024 6 commits
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
- [doc] Add engine section in backend.md (#1656) · c3f2fc5a
  Byron Hsu authored Oct 13, 2024
  
  c3f2fc5a
- Simplify the event loop and expose `--num-continuous-decode-steps` as an argument (#1652) · 7ee6c259
  Lianmin Zheng authored Oct 12, 2024
  
  7ee6c259
- Fix the batch_is_full check for jump-forward decoding (#1654) · 9610fcd4
  Lianmin Zheng authored Oct 12, 2024
  
  9610fcd4
- Add get_tokenizer function for Engine class (#1653) · 31fad29a
  Patrick Yi authored Oct 12, 2024
  
  31fad29a
- Add an option to disable penalizer (#1651) · 9da5a60b
  Lianmin Zheng authored Oct 12, 2024
  
  9da5a60b
12 Oct, 2024 4 commits
- Fix unit tests and type annotations (#1648) · 69aa937a
  Lianmin Zheng authored Oct 12, 2024
  
  69aa937a
- [Feature, Hardware] Enable SGLang on XPU GPUs via PyTorch (#1480) · 5d638c92
  Zhang, Liangang authored Oct 13, 2024
  
  5d638c92
- Fix ignore_eos (#1645) · e37cdab0
  Lianmin Zheng authored Oct 12, 2024
  
  e37cdab0
- fix missing ignore_eos in v1/chat/completions (#1642) · 1d9deeac
  LI MOU authored Oct 12, 2024
  
  1d9deeac
11 Oct, 2024 16 commits
- [Fix] Fix the style of test_large_max_new_tokens.py (#1638) · dafb6a52
  Lianmin Zheng authored Oct 11, 2024
  
  dafb6a52
- [engine] support async and streaming (#1614) · 862cd265
  Byron Hsu authored Oct 11, 2024
  
  862cd265
- Release v0.3.3.post1 (#1636) · 00c7e636
  Lianmin Zheng authored Oct 11, 2024
  
  00c7e636
- Add back data parallelism (#1635) · 23cc66f7
  Lianmin Zheng authored Oct 11, 2024
  
  23cc66f7
- Fix constrained decoding (#1634) · 5d09ca57
  Lianmin Zheng authored Oct 11, 2024
  
  5d09ca57
- Added a "Back To Top" Button (#1633) · 81c33274
  Janumala Akhilendra authored Oct 11, 2024
  
  81c33274
- Add image_token in conversation.py (#1632) · f13d86f9
  Lianmin Zheng authored Oct 11, 2024
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  f13d86f9
- Fix the correctness test in bench_latency.py when tp > 1 and test_generation_models.py (#1631) · aba9eae4
  Lianmin Zheng authored Oct 11, 2024
  
  aba9eae4
- Add the ability to enable and disable the Profiler via HTTP API. (#1626) · bbd72bfc
  科英 authored Oct 11, 2024
  
  bbd72bfc
- [Bug] Fix the Image Input of Batch Generation (#1579) · b503881b
  Yiding-Lu authored Oct 11, 2024
  
  b503881b
- Nit about the decorator of `PortArgs.init_new` (#1611) · 58093b86
  glen-amd authored Oct 11, 2024
  
  58093b86
- Add device support (#1607) · 8275049c
  Zhang, Liangang authored Oct 11, 2024
  
  8275049c
- Update README.md · 5476ccad
  Lianmin Zheng authored Oct 11, 2024
  
  5476ccad
- Update README.md (#1629) · b040ed71
  Lianmin Zheng authored Oct 11, 2024
  
  b040ed71
- Update README.md (#1625) · c9e66586
  Kushal Agrawal authored Oct 11, 2024
  
  c9e66586
- [Performance, hardware] MoE tuning update to AMD MI300x GPUs (#1619) · e11ab79e
  HAI authored Oct 10, 2024
  
  e11ab79e
10 Oct, 2024 1 commit
- Fix test_vision_openai_server on CI (#1620) · 01fdb2f3
  Byron Hsu authored Oct 10, 2024
  
  01fdb2f3
09 Oct, 2024 1 commit
- [Minor] Fix logging typo (#1615) · c996e8cc
  Amos You authored Oct 08, 2024
  
  c996e8cc
08 Oct, 2024 2 commits
- Release v0.3.3 (#1605) · 7b69d91b
  Lianmin Zheng authored Oct 08, 2024
  
  7b69d91b
- [Engine] Fix generate hanging issue after the first call (#1606) · e8613df0
  Byron Hsu authored Oct 07, 2024
  
  e8613df0
07 Oct, 2024 3 commits
- [Profile] Add pytorch profiler (#1604) · c5325aba
  Ying Sheng authored Oct 07, 2024
  
  c5325aba
- Optimize broadcast & Reorg code (#1598) · ebbc42d9
  Lianmin Zheng authored Oct 07, 2024
  
  ebbc42d9
- Remove references to squeezellm (#1603) · 3ff64113
  Jani Monoses authored Oct 07, 2024
  
  3ff64113