Commits · 05ff90b692a6cdac4d8c06e7a4a4606d1b8fe1d6 · norm / vllm

06 Dec, 2023 1 commit
- Save pytorch profiler output for latency benchmark (#1871) · 05ff90b6
  Antoni Baum authored Dec 05, 2023
```
* Save profiler output

* Apply feedback from code review
```
  05ff90b6
30 Nov, 2023 3 commits
- Support max-model-len argument for throughput benchmark (#1858) · 8d8c2f6f
  aisensiy authored Dec 01, 2023
  
  8d8c2f6f
- Remove max_num_seqs in latency benchmark script (#1855) · 51d3cb95
  Woosuk Kwon authored Nov 30, 2023
  
  51d3cb95
- Add profile option to latency benchmark script (#1839) · e74b1736
  Woosuk Kwon authored Nov 29, 2023
  
  e74b1736
24 Nov, 2023 1 commit
- [Build] Avoid building too many extensions (#1624) · e0c6f556
  Yanming W authored Nov 23, 2023
  
  e0c6f556
20 Nov, 2023 1 commit
- Migrate linter from `pylint` to `ruff` (#1665) · 5ffc0d13
  Simon Mo authored Nov 20, 2023
  
  5ffc0d13
17 Nov, 2023 1 commit
- [Minor] Fix comment (#1704) · dcc543a2
  Zhuofan authored Nov 18, 2023
  
  dcc543a2
14 Nov, 2023 1 commit
- Add DeepSpeed MII backend to benchmark script (#1649) · 660a7fcf
  Woosuk Kwon authored Nov 14, 2023
  
  660a7fcf
22 Oct, 2023 1 commit

chooper1 authored Oct 22, 2023


Co-authored-by: squeeze-ai-lab <squeezeailab.bair@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

1f24755b

16 Oct, 2023 1 commit
- Implement PagedAttention V2 (#1348) · 928de468
  Woosuk Kwon authored Oct 16, 2023
  
  928de468
03 Oct, 2023 1 commit
- Use monotonic time where appropriate (#1249) · acbed3ef
  Antoni Baum authored Oct 02, 2023
  
  acbed3ef
01 Oct, 2023 1 commit
- Added `dtype` arg to benchmarks (#1228) · b5a10eb0
  kg6-sleipnir authored Oct 01, 2023
  
  b5a10eb0
16 Sep, 2023 1 commit

Implement AWQ quantization support for LLaMA (#1032) · e3e79e9e

Woosuk Kwon authored Sep 16, 2023


Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>

e3e79e9e

20 Jul, 2023 2 commits
- fix: enable trust-remote-code in api server & benchmark. (#509) · 8c4b2592
  Ricardo Lu authored Jul 20, 2023
  
  8c4b2592
- support trust_remote_code in benchmark (#518) · cf21a9bd
  WRH authored Jul 20, 2023
  
  cf21a9bd
28 Jun, 2023 1 commit
- [Tokenizer] Add an option to specify tokenizer (#284) · 4338cc47
  Woosuk Kwon authored Jun 28, 2023
  
  4338cc47
26 Jun, 2023 1 commit
- [Fix] Fix default port number in benchmark scripts (#265) · 43710e8d
  Zhuohan Li authored Jun 26, 2023
  
  43710e8d
19 Jun, 2023 1 commit
- Remove benchmark_async_llm_server.py (#155) · 0370afa2
  Zhuohan Li authored Jun 19, 2023
  
  0370afa2
18 Jun, 2023 1 commit
- Add comments on swap space (#154) · 3f92038b
  Woosuk Kwon authored Jun 18, 2023
  
  3f92038b
17 Jun, 2023 3 commits
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
- [Minor] Fix benchmark_throughput.py (#151) · bab8f3dd
  Woosuk Kwon authored Jun 16, 2023
  
  bab8f3dd
16 Jun, 2023 1 commit
- Rename servers and change port numbers to reduce confusion (#149) · eedb46bf
  Zhuohan Li authored Jun 17, 2023
  
  eedb46bf
15 Jun, 2023 1 commit
- Add script for benchmarking serving throughput (#145) · 311490a7
  Woosuk Kwon authored Jun 14, 2023
  
  311490a7
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
04 Jun, 2023 1 commit
- Add docstrings for LLM (#137) · 8274ca23
  Woosuk Kwon authored Jun 04, 2023
  
  8274ca23
28 May, 2023 1 commit
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4