Commits · 0d02747f2ed5f65bd7100b6dcf1805cefb458f5d · OpenDAS / vllm_cscc

18 Sep, 2024 1 commit
- [CI/Build] Avoid CUDA initialization (#8534) · 6ffa3f31
  Cyrus Leung authored Sep 18, 2024
  
  6ffa3f31
12 Jul, 2024 1 commit
- [Model][Phi3-Small] Remove scipy from blocksparse_attention (#6343) · d59eb984
  Michael Goin authored Jul 11, 2024
  
  d59eb984
05 Jul, 2024 1 commit
- [Bugfix] Add verbose error if scipy is missing for blocksparse attention (#5695) · e58294dd
  JGSweets authored Jul 05, 2024
  
  e58294dd
03 Jul, 2024 1 commit
- [hardware][misc] introduce platform abstraction (#6080) · 482045ee
  youkaichao authored Jul 02, 2024
  
  482045ee
01 Jul, 2024 1 commit
- [misc][cuda] use nvml to avoid accidentally cuda initialization (#6007) · 614aa512
  youkaichao authored Jun 30, 2024
  
  614aa512
25 May, 2024 1 commit

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9