Commits · 4e2d95e372ad5fbef7b27c66d527c37477c0c8bb · OpenDAS / vllm_cscc

"vllm/entrypoints/openai/completion/serving.py" did not exist on "6d42ce83155d42f04643c1fa54eaed8abf8170c2"

28 Oct, 2024 1 commit
- [Hardware][ROCM] using current_platform.is_rocm (#9642) · 4e2d95e3
  wangshuai09 authored Oct 28, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  4e2d95e3
22 Oct, 2024 1 commit
- [Hardware][CPU] using current_platform.is_cpu (#9536) · 3ddbe255
  wangshuai09 authored Oct 22, 2024
  
  3ddbe255
18 Sep, 2024 1 commit
- [CI/Build] Avoid CUDA initialization (#8534) · 6ffa3f31
  Cyrus Leung authored Sep 18, 2024
  
  6ffa3f31
12 Jul, 2024 1 commit
- [Model][Phi3-Small] Remove scipy from blocksparse_attention (#6343) · d59eb984
  Michael Goin authored Jul 11, 2024
  
  d59eb984
05 Jul, 2024 1 commit
- [Bugfix] Add verbose error if scipy is missing for blocksparse attention (#5695) · e58294dd
  JGSweets authored Jul 05, 2024
  
  e58294dd
03 Jul, 2024 1 commit
- [hardware][misc] introduce platform abstraction (#6080) · 482045ee
  youkaichao authored Jul 02, 2024
  
  482045ee
01 Jul, 2024 1 commit
- [misc][cuda] use nvml to avoid accidentally cuda initialization (#6007) · 614aa512
  youkaichao authored Jun 30, 2024
  
  614aa512
25 May, 2024 1 commit

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9