Commits · 1a956e136beae057746af6257ffa8da601730f10 · norm / vllm

05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
24 May, 2023 3 commits
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
- Incrementally decode output tokens (#121) · e8671783
  Woosuk Kwon authored May 23, 2023
  
  e8671783
- Add contributing guideline and mypy config (#122) · a283ec2e
  Woosuk Kwon authored May 23, 2023
  
  a283ec2e
21 May, 2023 1 commit
- Implement stop strings and best_of (#114) · f746ced0
  Woosuk Kwon authored May 21, 2023
  
  f746ced0
20 May, 2023 1 commit
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f
11 May, 2023 1 commit
- Implement presence and frequency penalties (#95) · 55f8b0a5
  Woosuk Kwon authored May 10, 2023
  
  55f8b0a5
10 May, 2023 1 commit
- Rename variables and methods (#91) · 8d66a7b6
  Woosuk Kwon authored May 10, 2023
  
  8d66a7b6
12 Apr, 2023 1 commit
- Collect system stats in scheduler & Add scripts for experiments (#30) · 84eee24e
  Woosuk Kwon authored Apr 12, 2023
  
  84eee24e
30 Mar, 2023 1 commit
- Implement preemption via recomputation & Refactor scheduling logic (#12) · 7a7929ab
  Woosuk Kwon authored Mar 30, 2023
  
  7a7929ab
26 Mar, 2023 1 commit
- Minor · d359cda5
  Woosuk Kwon authored Mar 26, 2023
  
  d359cda5
21 Mar, 2023 1 commit
- Support tensor parallel (#2) · 2f49f155
  Zhuohan Li authored Mar 22, 2023
  
  2f49f155
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
24 Feb, 2023 1 commit
- Add is_finished · b39f149a
  Woosuk Kwon authored Feb 24, 2023
  
  b39f149a
23 Feb, 2023 2 commits
- Add get_len · af16c050
  Woosuk Kwon authored Feb 23, 2023
  
  af16c050
- Move max_context_len · d0945122
  Woosuk Kwon authored Feb 23, 2023
  
  d0945122
14 Feb, 2023 1 commit
- Add __repr__ · 3363c27d
  Woosuk Kwon authored Feb 14, 2023
  
  3363c27d
13 Feb, 2023 1 commit
- Add find method to sequence group · 0961f5a4
  Woosuk Kwon authored Feb 13, 2023
  
  0961f5a4
12 Feb, 2023 1 commit
- SERVING -> RUNNING · a2a9869c
  Woosuk Kwon authored Feb 12, 2023
  
  a2a9869c
09 Feb, 2023 1 commit
- Add sequence · d904350a
  Woosuk Kwon authored Feb 09, 2023
  
  d904350a