Commits · 99b471c205010a2b501073a9f1b4cbc6ef4db423 · OpenDAS / vllm_cscc

08 Apr, 2024 1 commit
- [Hotfix][CI/Build][Kernel] CUDA 11.8 does not support layernorm optimizations (#3782) · 59a6abf3
  Matt Wong authored Apr 08, 2024
  
  59a6abf3
30 Mar, 2024 1 commit
- [Kernel] Layernorm performance optimization (#3662) · b6d10354
  mawong-amd authored Mar 30, 2024
  
  b6d10354
03 Jan, 2024 1 commit
- [FIX] Support non-zero CUDA devices in custom kernels (#1959) · 77af974b
  Jee Li authored Jan 03, 2024
  
  77af974b
19 Nov, 2023 1 commit
- [Optimization] Implement fused add rmsnorm (#1667) · e1054247
  ljss authored Nov 19, 2023
  
  e1054247
17 Oct, 2023 1 commit
- Change scheduler & input tensor shape (#1381) · c1376e0f
  Woosuk Kwon authored Oct 16, 2023
  
  c1376e0f
02 Sep, 2023 1 commit
- Avoid compiling kernels for double data type (#933) · 8ce9c50d
  Woosuk Kwon authored Sep 02, 2023
  
  8ce9c50d
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
03 May, 2023 2 commits
- Support bfloat16 data type (#54) · e070829a
  Woosuk Kwon authored May 03, 2023
  
  e070829a
- Refactor attention kernels (#53) · 436e523b
  Woosuk Kwon authored May 03, 2023
  
  436e523b
31 Mar, 2023 1 commit
- Add custom kernel for RMS normalization (#16) · 09e92454
  Woosuk Kwon authored Mar 31, 2023
  
  09e92454