Commits · efb099cdee90b9ad332fcda96d89dd91ddebe072 · change / sglang

"src/diffusers/pipelines/controlnet/pipeline_controlnet.py" did not exist on "8b451eb63b0f101e7fcc72365fe0d683808b22cd"

21 Oct, 2024 3 commits
- Fix prefill oom (#1743) · efb099cd
  Liangsheng Yin authored Oct 21, 2024
  
  efb099cd
- Simplify batch result resolution (#1735) · b121bc03
  Lianmin Zheng authored Oct 20, 2024
  
  b121bc03
- Simplify the usage of device (#1734) · e12358dc
  Lianmin Zheng authored Oct 20, 2024
  
  e12358dc
20 Oct, 2024 3 commits
- Split the overlapped version of TpModelWorkerClient into a separate file (#1726) · b48edff6
  Lianmin Zheng authored Oct 20, 2024
  
  b48edff6
- Unify the memory pool api and tp worker API (#1724) · 59cbf476
  Lianmin Zheng authored Oct 19, 2024
  
  59cbf476
- Simplify the interface of tp_worker (#1718) · 12cad0fe
  Lianmin Zheng authored Oct 19, 2024
  
  12cad0fe
19 Oct, 2024 2 commits
- Fix the race condition in overlap mode (#1712) · 769bf11c
  Lianmin Zheng authored Oct 19, 2024
  
  769bf11c
- Skip unnecessary penalizer (#1707) · 2bcfba1b
  Lianmin Zheng authored Oct 18, 2024
  
  2bcfba1b
18 Oct, 2024 2 commits
- Add grouped free operations (#1706) · bc12d403
  Lianmin Zheng authored Oct 18, 2024
  
  bc12d403
- Fix regex and logprob conflicts when chunked prefilling (#1703) · 9e0dac1a
  Liangsheng Yin authored Oct 17, 2024
  
  9e0dac1a
16 Oct, 2024 3 commits
- Returning a per request metric for number of cached_tokens read (#1599) · ecb8bad2
  havetc authored Oct 16, 2024
  
  ecb8bad2
- Launch a thread to overlap CPU and GPU (#1687) · dbec2f18
  Lianmin Zheng authored Oct 16, 2024
  
  dbec2f18
- Add a new event loop (#1677) · 9116b289
  Lianmin Zheng authored Oct 16, 2024
  
  9116b289
15 Oct, 2024 2 commits
- Fix memory leak during abort (#1674) · f1088e0f
  Lianmin Zheng authored Oct 15, 2024
  
  f1088e0f
- [Minor] Add some utility functions (#1671) · 4a292f67
  Lianmin Zheng authored Oct 14, 2024
  
  4a292f67
14 Oct, 2024 6 commits
- Simplify chunked prefill (#1667) · 02bc9579
  Lianmin Zheng authored Oct 14, 2024
  
  02bc9579
- [Minor] Improve style (#1666) · 24f3e151
  Lianmin Zheng authored Oct 14, 2024
  
  24f3e151
- Move filter_batch out of stream_output (#1663) · 0c1e8796
  Lianmin Zheng authored Oct 14, 2024
  
  0c1e8796
- Add a test case to test retract (#1662) · 869f1c02
  Lianmin Zheng authored Oct 13, 2024
  
  869f1c02
- [Minor] Rename no_eos_trim to no_stop_trim (#1661) · 2725f8da
  Ying Sheng authored Oct 13, 2024
  
  2725f8da
- Add output_ids into ScheduleBatch (#1659) · da1ffed6
  Lianmin Zheng authored Oct 13, 2024
  
  da1ffed6
13 Oct, 2024 4 commits
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
- Simplify the event loop and expose `--num-continuous-decode-steps` as an argument (#1652) · 7ee6c259
  Lianmin Zheng authored Oct 12, 2024
  
  7ee6c259
- Fix the batch_is_full check for jump-forward decoding (#1654) · 9610fcd4
  Lianmin Zheng authored Oct 12, 2024
  
  9610fcd4
- Add an option to disable penalizer (#1651) · 9da5a60b
  Lianmin Zheng authored Oct 12, 2024
  
  9da5a60b
12 Oct, 2024 1 commit
- Fix unit tests and type annotations (#1648) · 69aa937a
  Lianmin Zheng authored Oct 12, 2024
  
  69aa937a
11 Oct, 2024 2 commits
- Add back data parallelism (#1635) · 23cc66f7
  Lianmin Zheng authored Oct 11, 2024
  
  23cc66f7
- Add the ability to enable and disable the Profiler via HTTP API. (#1626) · bbd72bfc
  科英 authored Oct 11, 2024
  
  bbd72bfc
10 Oct, 2024 1 commit
- Fix test_vision_openai_server on CI (#1620) · 01fdb2f3
  Byron Hsu authored Oct 10, 2024
  
  01fdb2f3
07 Oct, 2024 3 commits
- [Profile] Add pytorch profiler (#1604) · c5325aba
  Ying Sheng authored Oct 07, 2024
  
  c5325aba
- Optimize broadcast & Reorg code (#1598) · ebbc42d9
  Lianmin Zheng authored Oct 07, 2024
  
  ebbc42d9
- [Fix] Fix the case where prompt_len = 0 (#1593) · b6aad70a
  Lianmin Zheng authored Oct 06, 2024
  
  b6aad70a
06 Oct, 2024 2 commits
- Clean up event loop (#1586) · 58d1082e
  Lianmin Zheng authored Oct 06, 2024
  
  58d1082e
- [Minor] Improve the style and fix flaky tests (#1584) · 9244f27f
  Lianmin Zheng authored Oct 06, 2024
  
  9244f27f
05 Oct, 2024 1 commit
- Refine the add request reasons to avoid corner cases. (#1574) · 5d0ba403
  Liangsheng Yin authored Oct 04, 2024
  
  5d0ba403
04 Oct, 2024 3 commits
- [Fix] Fix major performance bug in certain cases (#1563) · 04b262cd
  Ying Sheng authored Oct 04, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  04b262cd
- Use ipc instead of tcp in zmq (#1566) · 114bbc86
  Lianmin Zheng authored Oct 04, 2024
  
  114bbc86
- Organize sampling batch info better (#1562) · 32eb6e96
  Lianmin Zheng authored Oct 03, 2024
  
  32eb6e96
30 Sep, 2024 2 commits
- Clean up batch data structures: Introducing ModelWorkerBatch (#1544) · 63ba2f8d
  Lianmin Zheng authored Sep 30, 2024
  
  63ba2f8d
- Rename InputMetadata -> ForwardBatch (#1543) · 36d5acfc
  Lianmin Zheng authored Sep 30, 2024
  
  36d5acfc