Commits · ad385667103b7a98fee5a4fc46d2a7745407333e · OpenDAS / vllm_cscc

09 Oct, 2024 1 commit
- 添加w8a8 rocblas非融合支持 · 35a8304d
  zhuwenwen authored Oct 09, 2024
  
  35a8304d
08 Aug, 2024 1 commit
- update offline_inference.py · dd0c8f49
  zhuwenwen authored Aug 08, 2024
  
  dd0c8f49
31 Jul, 2024 1 commit
- update benchmarks and examples · 1190e964
  zhuwenwen authored Jul 31, 2024
  
  1190e964
12 Jul, 2024 1 commit
- fix bf16 error · bb73b5a6
  zhuwenwen authored Jul 12, 2024
  
  bb73b5a6
06 Jul, 2024 1 commit
- fix ray error when tp>=2 · b6247705
  zhuwenwen authored Jul 06, 2024
  
  b6247705
03 Apr, 2024 1 commit
- update tests and offline_inference.py · 1951f478
  zhuwenwen authored Apr 03, 2024
  
  1951f478
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48