Commits · f1088e0fc87027a18347c98c0319e54eabbe6a03 · zhaoyu6 / sglang

"pointpillars/loss/__init__.py" did not exist on "420f8331635dec21f2998f66aace9eacaa6d5fd1"

15 Oct, 2024 4 commits
- Fix memory leak during abort (#1674) · f1088e0f
  Lianmin Zheng authored Oct 15, 2024
  
  f1088e0f
- Improve benchmark scripts (#1672) · 175afed3
  Lianmin Zheng authored Oct 14, 2024
  
  175afed3
- [Minor] Add some utility functions (#1671) · 4a292f67
  Lianmin Zheng authored Oct 14, 2024
  
  4a292f67
- [doc] improve engine doc and add to readme (#1670) · cd0be748
  Byron Hsu authored Oct 14, 2024
  
  cd0be748
14 Oct, 2024 9 commits
- [1/N] Remove `CacheConfig` import in all model files (#1658) · 56503d9b
  Byron Hsu authored Oct 14, 2024
  
  56503d9b
- Simplify chunked prefill (#1667) · 02bc9579
  Lianmin Zheng authored Oct 14, 2024
  
  02bc9579
- [Minor] Improve style (#1666) · 24f3e151
  Lianmin Zheng authored Oct 14, 2024
  
  24f3e151
- Fix unit test order to balance the tasks in CI (#1665) · 6790240c
  Lianmin Zheng authored Oct 14, 2024
  
  6790240c
- Support double sparsity (#1459) · 061e5463
  Shuo Yang authored Oct 14, 2024
  
  061e5463
- Move filter_batch out of stream_output (#1663) · 0c1e8796
  Lianmin Zheng authored Oct 14, 2024
  
  0c1e8796
- Add a test case to test retract (#1662) · 869f1c02
  Lianmin Zheng authored Oct 13, 2024
  
  869f1c02
- [Minor] Rename no_eos_trim to no_stop_trim (#1661) · 2725f8da
  Ying Sheng authored Oct 13, 2024
  
  2725f8da
- Add output_ids into ScheduleBatch (#1659) · da1ffed6
  Lianmin Zheng authored Oct 13, 2024
  
  da1ffed6
13 Oct, 2024 6 commits
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
- [doc] Add engine section in backend.md (#1656) · c3f2fc5a
  Byron Hsu authored Oct 13, 2024
  
  c3f2fc5a
- Simplify the event loop and expose `--num-continuous-decode-steps` as an argument (#1652) · 7ee6c259
  Lianmin Zheng authored Oct 12, 2024
  
  7ee6c259
- Fix the batch_is_full check for jump-forward decoding (#1654) · 9610fcd4
  Lianmin Zheng authored Oct 12, 2024
  
  9610fcd4
- Add get_tokenizer function for Engine class (#1653) · 31fad29a
  Patrick Yi authored Oct 12, 2024
  
  31fad29a
- Add an option to disable penalizer (#1651) · 9da5a60b
  Lianmin Zheng authored Oct 12, 2024
  
  9da5a60b
12 Oct, 2024 4 commits
- Fix unit tests and type annotations (#1648) · 69aa937a
  Lianmin Zheng authored Oct 12, 2024
  
  69aa937a
- [Feature, Hardware] Enable SGLang on XPU GPUs via PyTorch (#1480) · 5d638c92
  Zhang, Liangang authored Oct 13, 2024
  
  5d638c92
- Fix ignore_eos (#1645) · e37cdab0
  Lianmin Zheng authored Oct 12, 2024
  
  e37cdab0
- fix missing ignore_eos in v1/chat/completions (#1642) · 1d9deeac
  LI MOU authored Oct 12, 2024
  
  1d9deeac
11 Oct, 2024 16 commits
- [Fix] Fix the style of test_large_max_new_tokens.py (#1638) · dafb6a52
  Lianmin Zheng authored Oct 11, 2024
  
  dafb6a52
- [engine] support async and streaming (#1614) · 862cd265
  Byron Hsu authored Oct 11, 2024
  
  862cd265
- Release v0.3.3.post1 (#1636) · 00c7e636
  Lianmin Zheng authored Oct 11, 2024
  
  00c7e636
- Add back data parallelism (#1635) · 23cc66f7
  Lianmin Zheng authored Oct 11, 2024
  
  23cc66f7
- Fix constrained decoding (#1634) · 5d09ca57
  Lianmin Zheng authored Oct 11, 2024
  
  5d09ca57
- Added a "Back To Top" Button (#1633) · 81c33274
  Janumala Akhilendra authored Oct 11, 2024
  
  81c33274
- Add image_token in conversation.py (#1632) · f13d86f9
  Lianmin Zheng authored Oct 11, 2024
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  f13d86f9
- Fix the correctness test in bench_latency.py when tp > 1 and test_generation_models.py (#1631) · aba9eae4
  Lianmin Zheng authored Oct 11, 2024
  
  aba9eae4
- Add the ability to enable and disable the Profiler via HTTP API. (#1626) · bbd72bfc
  科英 authored Oct 11, 2024
  
  bbd72bfc
- [Bug] Fix the Image Input of Batch Generation (#1579) · b503881b
  Yiding-Lu authored Oct 11, 2024
  
  b503881b
- Nit about the decorator of `PortArgs.init_new` (#1611) · 58093b86
  glen-amd authored Oct 11, 2024
  
  58093b86
- Add device support (#1607) · 8275049c
  Zhang, Liangang authored Oct 11, 2024
  
  8275049c
- Update README.md · 5476ccad
  Lianmin Zheng authored Oct 11, 2024
  
  5476ccad
- Update README.md (#1629) · b040ed71
  Lianmin Zheng authored Oct 11, 2024
  
  b040ed71
- Update README.md (#1625) · c9e66586
  Kushal Agrawal authored Oct 11, 2024
  
  c9e66586
- [Performance, hardware] MoE tuning update to AMD MI300x GPUs (#1619) · e11ab79e
  HAI authored Oct 10, 2024
  
  e11ab79e
10 Oct, 2024 1 commit
- Fix test_vision_openai_server on CI (#1620) · 01fdb2f3
  Byron Hsu authored Oct 10, 2024
  
  01fdb2f3