Commits · 9f88db35da012544a9cd9450c68b8df2e6509b92 · norm / vllm

10 May, 2023 1 commit
- Support top-k sampling (#94) · 9f88db35
  Woosuk Kwon authored May 10, 2023
  
  9f88db35
09 May, 2023 3 commits
- Update sample prompts in `simple_server.py` (#89) · ce26e57f
  Woosuk Kwon authored May 09, 2023
  
  ce26e57f
- Refactor system architecture (#82) · 7c041ab5
  Woosuk Kwon authored May 09, 2023
  
  7c041ab5
- Add a system logger (#85) · 8917782a
  Woosuk Kwon authored May 08, 2023
  
  8917782a
03 May, 2023 1 commit
- New weight loader without np copy (#52) · 27f1410d
  Zhuohan Li authored May 03, 2023
  
  27f1410d
30 Apr, 2023 1 commit
- Add an option to launch cacheflow without ray (#51) · 4858f3bb
  Zhuohan Li authored Apr 30, 2023
  
  4858f3bb
12 Apr, 2023 1 commit
- Collect system stats in scheduler & Add scripts for experiments (#30) · 84eee24e
  Woosuk Kwon authored Apr 12, 2023
  
  84eee24e
09 Apr, 2023 1 commit
- Add an option to use dummy model weights (#33) · ee88a7e5
  Woosuk Kwon authored Apr 08, 2023
  
  ee88a7e5
05 Apr, 2023 1 commit
- Add CUDA graph-based all reduce launcher (#26) · 12659a0b
  Woosuk Kwon authored Apr 05, 2023
  
  12659a0b
29 Mar, 2023 1 commit
- FastAPI-based working frontend (#10) · 721fa3df
  Zhuohan Li authored Mar 29, 2023
  
  721fa3df