Commits · 3272d7a0b715a79059ebfcf8959d1ac0488ad18c · kecinstone / 2024pra-vllm

05 Sep, 2023 1 commit
- Align vLLM's beam search implementation with HF generate (#857) · 002800f0
  Zhuohan Li authored Sep 04, 2023
  
  002800f0
08 Jul, 2023 1 commit
- avoid python list copy in sequence initialization (#401) · 2179e4f4
  Lily Liu authored Jul 08, 2023
  
  2179e4f4
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
01 Jul, 2023 1 commit
- Raise error for long prompt (#273) · dafd924c
  Lily Liu authored Jun 30, 2023
  
  dafd924c
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
24 May, 2023 3 commits
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
- Incrementally decode output tokens (#121) · e8671783
  Woosuk Kwon authored May 23, 2023
  
  e8671783
- Add contributing guideline and mypy config (#122) · a283ec2e
  Woosuk Kwon authored May 23, 2023
  
  a283ec2e
21 May, 2023 1 commit
- Implement stop strings and best_of (#114) · f746ced0
  Woosuk Kwon authored May 21, 2023
  
  f746ced0
20 May, 2023 1 commit
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f
11 May, 2023 1 commit
- Implement presence and frequency penalties (#95) · 55f8b0a5
  Woosuk Kwon authored May 10, 2023
  
  55f8b0a5
10 May, 2023 1 commit
- Rename variables and methods (#91) · 8d66a7b6
  Woosuk Kwon authored May 10, 2023
  
  8d66a7b6
12 Apr, 2023 1 commit
- Collect system stats in scheduler & Add scripts for experiments (#30) · 84eee24e
  Woosuk Kwon authored Apr 12, 2023
  
  84eee24e
30 Mar, 2023 1 commit
- Implement preemption via recomputation & Refactor scheduling logic (#12) · 7a7929ab
  Woosuk Kwon authored Mar 30, 2023
  
  7a7929ab
26 Mar, 2023 1 commit
- Minor · d359cda5
  Woosuk Kwon authored Mar 26, 2023
  
  d359cda5
21 Mar, 2023 1 commit
- Support tensor parallel (#2) · 2f49f155
  Zhuohan Li authored Mar 22, 2023
  
  2f49f155
10 Mar, 2023 1 commit
- Support beam search & parallel generation (#7) · 1a7eb7da
  Woosuk Kwon authored Mar 10, 2023
  
  1a7eb7da
24 Feb, 2023 1 commit
- Add is_finished · b39f149a
  Woosuk Kwon authored Feb 24, 2023
  
  b39f149a
23 Feb, 2023 2 commits
- Add get_len · af16c050
  Woosuk Kwon authored Feb 23, 2023
  
  af16c050
- Move max_context_len · d0945122
  Woosuk Kwon authored Feb 23, 2023
  
  d0945122
14 Feb, 2023 1 commit
- Add __repr__ · 3363c27d
  Woosuk Kwon authored Feb 14, 2023
  
  3363c27d
13 Feb, 2023 1 commit
- Add find method to sequence group · 0961f5a4
  Woosuk Kwon authored Feb 13, 2023
  
  0961f5a4
12 Feb, 2023 1 commit
- SERVING -> RUNNING · a2a9869c
  Woosuk Kwon authored Feb 12, 2023
  
  a2a9869c
09 Feb, 2023 1 commit
- Add sequence · d904350a
  Woosuk Kwon authored Feb 09, 2023
  
  d904350a