Commits · ffad4e1e031a9facda4cab5b9fff31b47157aebc · norm / vllm

16 Feb, 2023 8 commits
- cache_kernel -> cache_kernels · ffad4e1e
  Woosuk Kwon authored Feb 16, 2023
  
  ffad4e1e
- Remove redundant fn · 6d2f74ef
  Woosuk Kwon authored Feb 16, 2023
  
  6d2f74ef
- Add gitignore · 3b41f165
  Woosuk Kwon authored Feb 16, 2023
  
  3b41f165
- Implement cache ops · 6f058c7b
  Woosuk Kwon authored Feb 16, 2023
  
  6f058c7b
- Minor · a1c67e6d
  Woosuk Kwon authored Feb 16, 2023
  
  a1c67e6d
- Fix return type error · 9e68a682
  Woosuk Kwon authored Feb 16, 2023
  
  9e68a682
- Add warning · 8edcabc7
  Woosuk Kwon authored Feb 16, 2023
  
  8edcabc7
- Fix KVCache shape · 2f4887de
  Woosuk Kwon authored Feb 16, 2023
  
  2f4887de
14 Feb, 2023 11 commits
- Add __repr__ · 3363c27d
  Woosuk Kwon authored Feb 14, 2023
  
  3363c27d
- Fix a ref count bug in swapping · 2729087e
  Woosuk Kwon authored Feb 14, 2023
  
  2729087e
- Fix double free · c128c2ed
  Woosuk Kwon authored Feb 14, 2023
  
  c128c2ed
- Minor · c80ed212
  Woosuk Kwon authored Feb 14, 2023
  
  c80ed212
- Minor · 263e91b3
  Woosuk Kwon authored Feb 14, 2023
  
  263e91b3
- Fix memory leak in swapping · be1e2163
  Woosuk Kwon authored Feb 14, 2023
  
  be1e2163
- Fix bugs in scheduler · 7e5f604e
  Woosuk Kwon authored Feb 14, 2023
  
  7e5f604e
- Fix a bug in swap_in and swap_out · 1f739f9b
  Woosuk Kwon authored Feb 14, 2023
  
  1f739f9b
- Fix can_swap_in · b1644f76
  Woosuk Kwon authored Feb 14, 2023
  
  b1644f76
- Fix typo · c574f195
  Woosuk Kwon authored Feb 14, 2023
  
  c574f195
- Fix typo · e40fa136
  Woosuk Kwon authored Feb 14, 2023
  
  e40fa136
13 Feb, 2023 8 commits
- Fix get_model · ee944251
  Woosuk Kwon authored Feb 13, 2023
  
  ee944251
- Fix typo · 531e1c74
  Woosuk Kwon authored Feb 13, 2023
  
  531e1c74
- Fix scheduler · d3d31766
  Woosuk Kwon authored Feb 13, 2023
  
  d3d31766
- Add model_utils · fffa2e1f
  Woosuk Kwon authored Feb 13, 2023
  
  fffa2e1f
- Fix cache engine · bb59a3e7
  Woosuk Kwon authored Feb 13, 2023
  
  bb59a3e7
- Add scheduler · 5a309bb5
  Woosuk Kwon authored Feb 13, 2023
  
  5a309bb5
- Add find method to sequence group · 0961f5a4
  Woosuk Kwon authored Feb 13, 2023
  
  0961f5a4
- Fix can_swap_in · eb52db1b
  Woosuk Kwon authored Feb 13, 2023
  
  eb52db1b
12 Feb, 2023 2 commits
- SERVING -> RUNNING · a2a9869c
  Woosuk Kwon authored Feb 12, 2023
  
  a2a9869c
- BlockAllocator -> BlockManager · 46958cf9
  Woosuk Kwon authored Feb 12, 2023
  
  46958cf9
09 Feb, 2023 11 commits
- Add blank setup file · 3be29a11
  Woosuk Kwon authored Feb 09, 2023
  
  3be29a11
- Minor · 38ed06a8
  Woosuk Kwon authored Feb 09, 2023
  
  38ed06a8
- Add gitignore · 0a11a2e5
  Woosuk Kwon authored Feb 09, 2023
  
  0a11a2e5
- Add cache engine · e7bee2aa
  Woosuk Kwon authored Feb 09, 2023
  
  e7bee2aa
- Add block manager · aa78aeaa
  Woosuk Kwon authored Feb 09, 2023
  
  aa78aeaa
- Add decoding params · 3c2b47fc
  Woosuk Kwon authored Feb 09, 2023
  
  3c2b47fc
- Add utils · 5e644b91
  Woosuk Kwon authored Feb 09, 2023
  
  5e644b91
- Add sequence · d904350a
  Woosuk Kwon authored Feb 09, 2023
  
  d904350a
- Add blocks · 6680129b
  Woosuk Kwon authored Feb 09, 2023
  
  6680129b
- Add OPT · 39161c98
  Woosuk Kwon authored Feb 09, 2023
  
  39161c98
- Initial commit · e7d9d9c0
  Woosuk Kwon authored Feb 09, 2023
  
  e7d9d9c0