Commits · 311490a720951f322977d811eacea685a623b5a1 · kecinstone / 2024pra-vllm

"test/infiniop/dequantize_awq.py" did not exist on "054763bc2e40b940bd2b5b4b37f056ba718fb789"

15 Jun, 2023 1 commit
- Add script for benchmarking serving throughput (#145) · 311490a7
  Woosuk Kwon authored Jun 14, 2023
  
  311490a7
07 Jun, 2023 2 commits
- Add docstrings for LLMServer and related classes and examples (#142) · 42983742
  Zhuohan Li authored Jun 07, 2023
  
  42983742
- Support FP32 (#141) · e38074b1
  Woosuk Kwon authored Jun 07, 2023
  
  e38074b1
06 Jun, 2023 1 commit
- [PyPI] Packaging for PyPI distribution (#140) · 376725ce
  Woosuk Kwon authored Jun 05, 2023
  
  376725ce
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
04 Jun, 2023 1 commit
- Add docstrings for LLM (#137) · 8274ca23
  Woosuk Kwon authored Jun 04, 2023
  
  8274ca23
28 May, 2023 2 commits
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4
- Enable LLaMA fast tokenizer (#132) · 337871c6
  Woosuk Kwon authored May 28, 2023
  
  337871c6
24 May, 2023 4 commits
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
- Incrementally decode output tokens (#121) · e8671783
  Woosuk Kwon authored May 23, 2023
  
  e8671783
- Print warnings/errors for large swap space (#123) · aedba6d5
  Woosuk Kwon authored May 23, 2023
  
  aedba6d5
- Add contributing guideline and mypy config (#122) · a283ec2e
  Woosuk Kwon authored May 23, 2023
  
  a283ec2e
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48
21 May, 2023 1 commit
- Implement stop strings and best_of (#114) · f746ced0
  Woosuk Kwon authored May 21, 2023
  
  f746ced0
20 May, 2023 1 commit
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f