Commits · ac8d36f3e5776e020eb32a08eb3a2f9c60a49344 · norm / vllm

30 Oct, 2023 1 commit
- Refactor LLMEngine demo script for clarity and modularity (#1413) · ac8d36f3
  iongpt authored Oct 30, 2023
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  ac8d36f3
16 Oct, 2023 1 commit
- Implement prompt logprobs & Batched topk for computing logprobs (#1328) · 9d9072a0
  Zhuohan Li authored Oct 16, 2023
```
Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>
```
  9d9072a0
07 Oct, 2023 1 commit
- API server support ipv4 / ipv6 dualstack (#1288) · 09ff7f10
  Yunfeng Bai authored Oct 07, 2023
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  09ff7f10
02 Aug, 2023 2 commits
- Refactor scheduler (#658) · 55fe8a81
  Woosuk Kwon authored Aug 02, 2023
  
  55fe8a81
- Add Falcon support (new) (#592) · 1b0bd0fe
  Zhuohan Li authored Aug 02, 2023
  
  1b0bd0fe
26 Jul, 2023 1 commit
- [Fix] Add chat completion Example and simplify dependencies (#576) · 82ad323d
  Zhuohan Li authored Jul 25, 2023
  
  82ad323d
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
22 Jun, 2023 1 commit
- [Bugfix] Fix a bug in RequestOutput.finished (#202) · 14f0b39c
  Woosuk Kwon authored Jun 22, 2023
  
  14f0b39c
17 Jun, 2023 2 commits
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
16 Jun, 2023 1 commit
- Rename servers and change port numbers to reduce confusion (#149) · eedb46bf
  Zhuohan Li authored Jun 17, 2023
  
  eedb46bf
15 Jun, 2023 1 commit
- Add script for benchmarking serving throughput (#145) · 311490a7
  Woosuk Kwon authored Jun 14, 2023
  
  311490a7
10 Jun, 2023 1 commit
- Non-streaming simple fastapi server (#144) · 5020e1e8
  Zhuohan Li authored Jun 11, 2023
  
  5020e1e8
07 Jun, 2023 1 commit
- Add docstrings for LLMServer and related classes and examples (#142) · 42983742
  Zhuohan Li authored Jun 07, 2023
  
  42983742
28 May, 2023 1 commit
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4
24 May, 2023 1 commit
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48
21 May, 2023 1 commit
- Implement stop strings and best_of (#114) · f746ced0
  Woosuk Kwon authored May 21, 2023
  
  f746ced0
20 May, 2023 1 commit
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f