Commits · ecb8bad276ea13e243a36cc23adca8207fac4657 · change / sglang

"git@developer.sourcefind.cn:renzhc/diffusers_dcu.git" did not exist on "759ea587082aa0e77449952d8f3523f28ddc61f3"

16 Oct, 2024 6 commits
- Returning a per request metric for number of cached_tokens read (#1599) · ecb8bad2
  havetc authored Oct 16, 2024
  
  ecb8bad2
- Launch a thread to overlap CPU and GPU (#1687) · dbec2f18
  Lianmin Zheng authored Oct 16, 2024
  
  dbec2f18
- Fix srt dependency (#1685) · d10b933a
  Ke Bao authored Oct 16, 2024
  
  d10b933a
- Add a new event loop (#1677) · 9116b289
  Lianmin Zheng authored Oct 16, 2024
  
  9116b289
- Add OLMo model (#1676) · a5114b6f
  Jani Monoses authored Oct 16, 2024
  
  a5114b6f
- Fix filter_batch function call (#1681) · b6b40946
  Liangsheng Yin authored Oct 15, 2024
  
  b6b40946
15 Oct, 2024 3 commits
- Fix memory leak during abort (#1674) · f1088e0f
  Lianmin Zheng authored Oct 15, 2024
  
  f1088e0f
- Improve benchmark scripts (#1672) · 175afed3
  Lianmin Zheng authored Oct 14, 2024
  
  175afed3
- [Minor] Add some utility functions (#1671) · 4a292f67
  Lianmin Zheng authored Oct 14, 2024
  
  4a292f67
14 Oct, 2024 9 commits
- [1/N] Remove `CacheConfig` import in all model files (#1658) · 56503d9b
  Byron Hsu authored Oct 14, 2024
  
  56503d9b
- Simplify chunked prefill (#1667) · 02bc9579
  Lianmin Zheng authored Oct 14, 2024
  
  02bc9579
- [Minor] Improve style (#1666) · 24f3e151
  Lianmin Zheng authored Oct 14, 2024
  
  24f3e151
- Fix unit test order to balance the tasks in CI (#1665) · 6790240c
  Lianmin Zheng authored Oct 14, 2024
  
  6790240c
- Support double sparsity (#1459) · 061e5463
  Shuo Yang authored Oct 14, 2024
  
  061e5463
- Move filter_batch out of stream_output (#1663) · 0c1e8796
  Lianmin Zheng authored Oct 14, 2024
  
  0c1e8796
- Add a test case to test retract (#1662) · 869f1c02
  Lianmin Zheng authored Oct 13, 2024
  
  869f1c02
- [Minor] Rename no_eos_trim to no_stop_trim (#1661) · 2725f8da
  Ying Sheng authored Oct 13, 2024
  
  2725f8da
- Add output_ids into ScheduleBatch (#1659) · da1ffed6
  Lianmin Zheng authored Oct 13, 2024
  
  da1ffed6
13 Oct, 2024 5 commits
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
- Simplify the event loop and expose `--num-continuous-decode-steps` as an argument (#1652) · 7ee6c259
  Lianmin Zheng authored Oct 12, 2024
  
  7ee6c259
- Fix the batch_is_full check for jump-forward decoding (#1654) · 9610fcd4
  Lianmin Zheng authored Oct 12, 2024
  
  9610fcd4
- Add get_tokenizer function for Engine class (#1653) · 31fad29a
  Patrick Yi authored Oct 12, 2024
  
  31fad29a
- Add an option to disable penalizer (#1651) · 9da5a60b
  Lianmin Zheng authored Oct 12, 2024
  
  9da5a60b
12 Oct, 2024 4 commits
- Fix unit tests and type annotations (#1648) · 69aa937a
  Lianmin Zheng authored Oct 12, 2024
  
  69aa937a
- [Feature, Hardware] Enable SGLang on XPU GPUs via PyTorch (#1480) · 5d638c92
  Zhang, Liangang authored Oct 13, 2024
  
  5d638c92
- Fix ignore_eos (#1645) · e37cdab0
  Lianmin Zheng authored Oct 12, 2024
  
  e37cdab0
- fix missing ignore_eos in v1/chat/completions (#1642) · 1d9deeac
  LI MOU authored Oct 12, 2024
  
  1d9deeac
11 Oct, 2024 11 commits
- [engine] support async and streaming (#1614) · 862cd265
  Byron Hsu authored Oct 11, 2024
  
  862cd265
- Release v0.3.3.post1 (#1636) · 00c7e636
  Lianmin Zheng authored Oct 11, 2024
  
  00c7e636
- Add back data parallelism (#1635) · 23cc66f7
  Lianmin Zheng authored Oct 11, 2024
  
  23cc66f7
- Fix constrained decoding (#1634) · 5d09ca57
  Lianmin Zheng authored Oct 11, 2024
  
  5d09ca57
- Add image_token in conversation.py (#1632) · f13d86f9
  Lianmin Zheng authored Oct 11, 2024
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  f13d86f9
- Fix the correctness test in bench_latency.py when tp > 1 and test_generation_models.py (#1631) · aba9eae4
  Lianmin Zheng authored Oct 11, 2024
  
  aba9eae4
- Add the ability to enable and disable the Profiler via HTTP API. (#1626) · bbd72bfc
  科英 authored Oct 11, 2024
  
  bbd72bfc
- [Bug] Fix the Image Input of Batch Generation (#1579) · b503881b
  Yiding-Lu authored Oct 11, 2024
  
  b503881b
- Nit about the decorator of `PortArgs.init_new` (#1611) · 58093b86
  glen-amd authored Oct 11, 2024
  
  58093b86
- Add device support (#1607) · 8275049c
  Zhang, Liangang authored Oct 11, 2024
  
  8275049c
- [Performance, hardware] MoE tuning update to AMD MI300x GPUs (#1619) · e11ab79e
  HAI authored Oct 10, 2024
  
  e11ab79e
10 Oct, 2024 1 commit
- Fix test_vision_openai_server on CI (#1620) · 01fdb2f3
  Byron Hsu authored Oct 10, 2024
  
  01fdb2f3
09 Oct, 2024 1 commit
- [Minor] Fix logging typo (#1615) · c996e8cc
  Amos You authored Oct 08, 2024
  
  c996e8cc