Commits · 0eda2e0953080467eb98f2730341acea0287cdc0 · norm / vllm

28 May, 2023 1 commit
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4
25 May, 2023 1 commit
- Add activation registry (#126) · 4a151dd4
  Woosuk Kwon authored May 25, 2023
  
  4a151dd4
23 May, 2023 1 commit
- Fix latency benchmark script (#118) · 3f942acf
  Woosuk Kwon authored May 22, 2023
  
  3f942acf
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48