Commits · b5a10eb0ef68f45c7dbdef2917e02bebca780d1a · norm / vllm

01 Oct, 2023 1 commit
- Added `dtype` arg to benchmarks (#1228) · b5a10eb0
  kg6-sleipnir authored Oct 01, 2023
  
  b5a10eb0
16 Sep, 2023 1 commit

Implement AWQ quantization support for LLaMA (#1032) · e3e79e9e

Woosuk Kwon authored Sep 16, 2023


Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>

e3e79e9e

20 Jul, 2023 2 commits
- fix: enable trust-remote-code in api server & benchmark. (#509) · 8c4b2592
  Ricardo Lu authored Jul 20, 2023
  
  8c4b2592
- support trust_remote_code in benchmark (#518) · cf21a9bd
  WRH authored Jul 20, 2023
  
  cf21a9bd
28 Jun, 2023 1 commit
- [Tokenizer] Add an option to specify tokenizer (#284) · 4338cc47
  Woosuk Kwon authored Jun 28, 2023
  
  4338cc47
26 Jun, 2023 1 commit
- [Fix] Fix default port number in benchmark scripts (#265) · 43710e8d
  Zhuohan Li authored Jun 26, 2023
  
  43710e8d
19 Jun, 2023 1 commit
- Remove benchmark_async_llm_server.py (#155) · 0370afa2
  Zhuohan Li authored Jun 19, 2023
  
  0370afa2
18 Jun, 2023 1 commit
- Add comments on swap space (#154) · 3f92038b
  Woosuk Kwon authored Jun 18, 2023
  
  3f92038b
17 Jun, 2023 3 commits
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
- [Minor] Fix benchmark_throughput.py (#151) · bab8f3dd
  Woosuk Kwon authored Jun 16, 2023
  
  bab8f3dd
16 Jun, 2023 1 commit
- Rename servers and change port numbers to reduce confusion (#149) · eedb46bf
  Zhuohan Li authored Jun 17, 2023
  
  eedb46bf
15 Jun, 2023 1 commit
- Add script for benchmarking serving throughput (#145) · 311490a7
  Woosuk Kwon authored Jun 14, 2023
  
  311490a7
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
04 Jun, 2023 1 commit
- Add docstrings for LLM (#137) · 8274ca23
  Woosuk Kwon authored Jun 04, 2023
  
  8274ca23
28 May, 2023 1 commit
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4