Commits · 0ffded812aa9193838c3daae87981b46b2c6068c · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "3be5b26a7651b57aeb2cbdfc6aee81152ba68da5"

01 Jul, 2023 1 commit
- Raise error for long prompt (#273) · dafd924c
  Lily Liu authored Jun 30, 2023
  
  dafd924c
28 Jun, 2023 2 commits
- [Tokenizer] Add tokenizer mode (#298) · 998d9d15
  Woosuk Kwon authored Jun 28, 2023
  
  998d9d15
- [Tokenizer] Add an option to specify tokenizer (#284) · 4338cc47
  Woosuk Kwon authored Jun 28, 2023
  
  4338cc47
26 Jun, 2023 1 commit
- [Bug] Fix the OOM condition for CPU cache (#260) · 0b7db411
  Zhuohan Li authored Jun 26, 2023
  
  0b7db411
25 Jun, 2023 1 commit
- fix wrong using getattr to get dict value (#232) · 06033798
  metacryptom authored Jun 25, 2023
  
  06033798
22 Jun, 2023 2 commits
- [Fix] Better error message when there is OOM during cache initialization (#203) · 1d24ccb9
  Zhuohan Li authored Jun 22, 2023
  
  1d24ccb9
- [Bugfix] Fix a bug in RequestOutput.finished (#202) · 14f0b39c
  Woosuk Kwon authored Jun 22, 2023
  
  14f0b39c
21 Jun, 2023 1 commit
- fix-ray (#193) · 2e0d3143
  Zhuohan Li authored Jun 22, 2023
  
  2e0d3143
20 Jun, 2023 1 commit
- Use slow tokenizer for open llama models (#168) · 67d96c29
  Woosuk Kwon authored Jun 19, 2023
  
  67d96c29
18 Jun, 2023 1 commit
- Reduce GPU memory utilization to make sure OOM doesn't happen (#153) · bf5f121c
  Zhuohan Li authored Jun 18, 2023
  
  bf5f121c
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15