Commits · 311490a720951f322977d811eacea685a623b5a1 · norm / vllm

15 Jun, 2023 1 commit
- Add script for benchmarking serving throughput (#145) · 311490a7
  Woosuk Kwon authored Jun 14, 2023
  
  311490a7
10 Jun, 2023 1 commit
- Non-streaming simple fastapi server (#144) · 5020e1e8
  Zhuohan Li authored Jun 11, 2023
  
  5020e1e8
07 Jun, 2023 1 commit
- Add docstrings for LLMServer and related classes and examples (#142) · 42983742
  Zhuohan Li authored Jun 07, 2023
  
  42983742
28 May, 2023 1 commit
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4
24 May, 2023 1 commit
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48
21 May, 2023 1 commit
- Implement stop strings and best_of (#114) · f746ced0
  Woosuk Kwon authored May 21, 2023
  
  f746ced0
20 May, 2023 1 commit
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f