Commits · ea5f14e6ffafcb9c660a3eea5a935122aa9f84ae · OpenDAS / vllm_cscc

11 Mar, 2024 1 commit
- Support Mistral Model Inference with transformers-neuronx (#3153) · 654865e2
  DAIZHENWEI authored Mar 11, 2024
  
  654865e2
28 Feb, 2024 1 commit
- [Neuron] Support inference with transformers-neuronx (#2569) · 3b7178cf
  Liangfu Chen authored Feb 28, 2024
  
  3b7178cf
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48