Commits · bc0c0192d13ca6ea4aeea4725f752a89483895bc · OpenDAS / vllm_cscc

30 Mar, 2024 1 commit
- [Kernel] Layernorm performance optimization (#3662) · b6d10354
  mawong-amd authored Mar 30, 2024
  
  b6d10354
03 Jan, 2024 1 commit
- [FIX] Support non-zero CUDA devices in custom kernels (#1959) · 77af974b
  Jee Li authored Jan 03, 2024
  
  77af974b
19 Nov, 2023 1 commit
- [Optimization] Implement fused add rmsnorm (#1667) · e1054247
  ljss authored Nov 19, 2023
  
  e1054247
17 Oct, 2023 1 commit
- Change scheduler & input tensor shape (#1381) · c1376e0f
  Woosuk Kwon authored Oct 16, 2023
  
  c1376e0f
02 Sep, 2023 1 commit
- Avoid compiling kernels for double data type (#933) · 8ce9c50d
  Woosuk Kwon authored Sep 02, 2023
  
  8ce9c50d
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
03 May, 2023 2 commits
- Support bfloat16 data type (#54) · e070829a
  Woosuk Kwon authored May 03, 2023
  
  e070829a
- Refactor attention kernels (#53) · 436e523b
  Woosuk Kwon authored May 03, 2023
  
  436e523b
31 Mar, 2023 1 commit
- Add custom kernel for RMS normalization (#16) · 09e92454
  Woosuk Kwon authored Mar 31, 2023
  
  09e92454