Commits · 7a7929abe8e2fd6a4688487c471a1ee1fde0edd2 · norm / vllm

30 Mar, 2023 1 commit
- Implement preemption via recomputation & Refactor scheduling logic (#12) · 7a7929ab
  Woosuk Kwon authored Mar 30, 2023
  
  7a7929ab
29 Mar, 2023 1 commit
- Add cache watermark to avoid frequent cache eviction (#11) · 64e0e383
  Woosuk Kwon authored Mar 29, 2023
  
  64e0e383
26 Mar, 2023 1 commit
- Minor · d359cda5
  Woosuk Kwon authored Mar 26, 2023
  
  d359cda5
01 Mar, 2023 1 commit
- Implement `single_query_cached_kv_attention` kernel (#3) · 0deacbce
  Woosuk Kwon authored Mar 01, 2023
  
  0deacbce
23 Feb, 2023 1 commit
- Add get_block_table · 4f6f4967
  Woosuk Kwon authored Feb 23, 2023
  
  4f6f4967
14 Feb, 2023 7 commits
- Fix a ref count bug in swapping · 2729087e
  Woosuk Kwon authored Feb 14, 2023
  
  2729087e
- Fix double free · c128c2ed
  Woosuk Kwon authored Feb 14, 2023
  
  c128c2ed
- Minor · c80ed212
  Woosuk Kwon authored Feb 14, 2023
  
  c80ed212
- Minor · 263e91b3
  Woosuk Kwon authored Feb 14, 2023
  
  263e91b3
- Fix memory leak in swapping · be1e2163
  Woosuk Kwon authored Feb 14, 2023
  
  be1e2163
- Fix a bug in swap_in and swap_out · 1f739f9b
  Woosuk Kwon authored Feb 14, 2023
  
  1f739f9b
- Fix can_swap_in · b1644f76
  Woosuk Kwon authored Feb 14, 2023
  
  b1644f76
13 Feb, 2023 1 commit
- Fix can_swap_in · eb52db1b
  Woosuk Kwon authored Feb 13, 2023
  
  eb52db1b
12 Feb, 2023 2 commits
- SERVING -> RUNNING · a2a9869c
  Woosuk Kwon authored Feb 12, 2023
  
  a2a9869c
- BlockAllocator -> BlockManager · 46958cf9
  Woosuk Kwon authored Feb 12, 2023
  
  46958cf9
09 Feb, 2023 2 commits
- Minor · 38ed06a8
  Woosuk Kwon authored Feb 09, 2023
  
  38ed06a8
- Add block manager · aa78aeaa
  Woosuk Kwon authored Feb 09, 2023
  
  aa78aeaa