Commits · 39ae4102df498086488fd66f6c8cfbfb5f7ee089 · OpenDAS / vllm_cscc

08 Aug, 2024 1 commit
- update offline_inference.py · dd0c8f49
  zhuwenwen authored Aug 08, 2024
  
  dd0c8f49
31 Jul, 2024 1 commit
- update benchmarks and examples · 1190e964
  zhuwenwen authored Jul 31, 2024
  
  1190e964
12 Jul, 2024 1 commit
- fix bf16 error · bb73b5a6
  zhuwenwen authored Jul 12, 2024
  
  bb73b5a6
06 Jul, 2024 1 commit
- fix ray error when tp>=2 · b6247705
  zhuwenwen authored Jul 06, 2024
  
  b6247705
03 Apr, 2024 1 commit
- update tests and offline_inference.py · 1951f478
  zhuwenwen authored Apr 03, 2024
  
  1951f478
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48