Commits · 0b7db411b5af4bf8a3a0cf989daa024ba5401ac1 · kecinstone / 2024pra-vllm

26 Jun, 2023 1 commit
- [Bug] Fix the OOM condition for CPU cache (#260) · 0b7db411
  Zhuohan Li authored Jun 26, 2023
  
  0b7db411
22 Jun, 2023 1 commit
- [Fix] Better error message when there is OOM during cache initialization (#203) · 1d24ccb9
  Zhuohan Li authored Jun 22, 2023
  
  1d24ccb9
21 Jun, 2023 1 commit
- fix-ray (#193) · 2e0d3143
  Zhuohan Li authored Jun 22, 2023
  
  2e0d3143
17 Jun, 2023 2 commits
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
16 Jun, 2023 1 commit
- Rename servers and change port numbers to reduce confusion (#149) · eedb46bf
  Zhuohan Li authored Jun 17, 2023
  
  eedb46bf
07 Jun, 2023 1 commit
- Add docstrings for LLMServer and related classes and examples (#142) · 42983742
  Zhuohan Li authored Jun 07, 2023
  
  42983742
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
04 Jun, 2023 1 commit
- Add docstrings for LLM (#137) · 8274ca23
  Woosuk Kwon authored Jun 04, 2023
  
  8274ca23
28 May, 2023 1 commit
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4
24 May, 2023 3 commits
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
- Incrementally decode output tokens (#121) · e8671783
  Woosuk Kwon authored May 23, 2023
  
  e8671783
- Print warnings/errors for large swap space (#123) · aedba6d5
  Woosuk Kwon authored May 23, 2023
  
  aedba6d5
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48
21 May, 2023 1 commit
- Implement stop strings and best_of (#114) · f746ced0
  Woosuk Kwon authored May 21, 2023
  
  f746ced0
20 May, 2023 1 commit
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f