Commits · 84eee24e20ff4c0fc1b126289265f560089efa47 · norm / vllm

12 Apr, 2023 1 commit
- Collect system stats in scheduler & Add scripts for experiments (#30) · 84eee24e
  Woosuk Kwon authored Apr 12, 2023
  
  84eee24e
30 Mar, 2023 1 commit
- Implement preemption via recomputation & Refactor scheduling logic (#12) · 7a7929ab
  Woosuk Kwon authored Mar 30, 2023
  
  7a7929ab
26 Mar, 2023 1 commit
- Minor · d359cda5
  Woosuk Kwon authored Mar 26, 2023
  
  d359cda5
21 Mar, 2023 1 commit
- Support tensor parallel (#2) · 2f49f155
  Zhuohan Li authored Mar 22, 2023
  
  2f49f155
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
24 Feb, 2023 1 commit
- Add is_finished · b39f149a
  Woosuk Kwon authored Feb 24, 2023
  
  b39f149a
23 Feb, 2023 2 commits
- Add get_len · af16c050
  Woosuk Kwon authored Feb 23, 2023
  
  af16c050
- Move max_context_len · d0945122
  Woosuk Kwon authored Feb 23, 2023
  
  d0945122
14 Feb, 2023 1 commit
- Add __repr__ · 3363c27d
  Woosuk Kwon authored Feb 14, 2023
  
  3363c27d
13 Feb, 2023 1 commit
- Add find method to sequence group · 0961f5a4
  Woosuk Kwon authored Feb 13, 2023
  
  0961f5a4
12 Feb, 2023 1 commit
- SERVING -> RUNNING · a2a9869c
  Woosuk Kwon authored Feb 12, 2023
  
  a2a9869c
09 Feb, 2023 1 commit
- Add sequence · d904350a
  Woosuk Kwon authored Feb 09, 2023
  
  d904350a