Commits · 4d3a2c284ecc47748273664c9a6ef302ff3adcbe · OpenDAS / vllm_cscc

04 Dec, 2024 1 commit
- update offline_inference.py · 4646fe24
  zhuwenwen authored Dec 04, 2024
  
  4646fe24
26 Nov, 2024 1 commit

[Feature] vLLM ARM Enablement for AARCH64 CPUs (#9228) · a6760f64

Sanket Kale authored Nov 26, 2024


Signed-off-by: Sanket Kale <sanketk.kale@fujitsu.com>
Co-authored-by: Sanket Kale <sanketk.kale@fujitsu.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

a6760f64

21 Nov, 2024 1 commit
- [Minor] Revert change in offline inference example (#10545) · 46fe9b46
  Woosuk Kwon authored Nov 21, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  46fe9b46
17 Nov, 2024 1 commit
- [Misc] Enhance offline_inference to support user-configurable paramet… (#10392) · d1557e66
  wchen61 authored Nov 17, 2024
```
Signed-off-by: wchen61 <wchen61@foxmail.com>
```
  d1557e66
09 Oct, 2024 1 commit
- 添加w8a8 rocblas非融合支持 · 35a8304d
  zhuwenwen authored Oct 09, 2024
  
  35a8304d
08 Aug, 2024 1 commit
- update offline_inference.py · dd0c8f49
  zhuwenwen authored Aug 08, 2024
  
  dd0c8f49
31 Jul, 2024 1 commit
- update benchmarks and examples · 1190e964
  zhuwenwen authored Jul 31, 2024
  
  1190e964
12 Jul, 2024 1 commit
- fix bf16 error · bb73b5a6
  zhuwenwen authored Jul 12, 2024
  
  bb73b5a6
06 Jul, 2024 1 commit
- fix ray error when tp>=2 · b6247705
  zhuwenwen authored Jul 06, 2024
  
  b6247705
03 Apr, 2024 1 commit
- update tests and offline_inference.py · 1951f478
  zhuwenwen authored Apr 03, 2024
  
  1951f478
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48