Commits · 86f9eb6d39f12372c7349809485d743241f58907 · OpenDAS / vllm_cscc

".github/vscode:/vscode.git/clone" did not exist on "bffddd9a05a6d0d3ea04b7baad1966e4f57f94c7"

23 Feb, 2023 12 commits
- Fix typo · 86f9eb6d
  Woosuk Kwon authored Feb 23, 2023
  
  86f9eb6d
- Add controller · 1f6c7ef4
  Woosuk Kwon authored Feb 23, 2023
  
  1f6c7ef4
- Add unoptimized OPT Attention · d4bc1a4d
  Woosuk Kwon authored Feb 23, 2023
  
  d4bc1a4d
- Add greedy sampler · b56b6ca0
  Woosuk Kwon authored Feb 23, 2023
  
  b56b6ca0
- Add seq_ids to input metadata · 343cea3d
  Woosuk Kwon authored Feb 23, 2023
  
  343cea3d
- Add get_block_table · 4f6f4967
  Woosuk Kwon authored Feb 23, 2023
  
  4f6f4967
- Implement scheduler.step & Add a threshold for batch size · 331fa0b0
  Woosuk Kwon authored Feb 23, 2023
  
  331fa0b0
- decoding.py -> sampling_params.py · 501c4bd0
  Woosuk Kwon authored Feb 23, 2023
  
  501c4bd0
- DecodingParams -> SamplingParams · 86c682cd
  Woosuk Kwon authored Feb 23, 2023
  
  86c682cd
- Add get_len · af16c050
  Woosuk Kwon authored Feb 23, 2023
  
  af16c050
- Move max_context_len · d0945122
  Woosuk Kwon authored Feb 23, 2023
  
  d0945122
- Fix slot mapping · 4b1ac23f
  Woosuk Kwon authored Feb 23, 2023
  
  4b1ac23f
22 Feb, 2023 4 commits
- Add Worker class · 8290fce4
  Woosuk Kwon authored Feb 22, 2023
  
  8290fce4
- Add input metadata · 7b6844e5
  Woosuk Kwon authored Feb 22, 2023
  
  7b6844e5
- Minor · 608f74ff
  Woosuk Kwon authored Feb 22, 2023
  
  608f74ff
- Move worker/models -> models · 709a6917
  Woosuk Kwon authored Feb 22, 2023
  
  709a6917
18 Feb, 2023 2 commits
- Add tests for kernels · af68ec1c
  Woosuk Kwon authored Feb 18, 2023
  
  af68ec1c
- Add reshape_and_cache op · c413c41c
  Woosuk Kwon authored Feb 18, 2023
  
  c413c41c
16 Feb, 2023 8 commits
- cache_kernel -> cache_kernels · ffad4e1e
  Woosuk Kwon authored Feb 16, 2023
  
  ffad4e1e
- Remove redundant fn · 6d2f74ef
  Woosuk Kwon authored Feb 16, 2023
  
  6d2f74ef
- Add gitignore · 3b41f165
  Woosuk Kwon authored Feb 16, 2023
  
  3b41f165
- Implement cache ops · 6f058c7b
  Woosuk Kwon authored Feb 16, 2023
  
  6f058c7b
- Minor · a1c67e6d
  Woosuk Kwon authored Feb 16, 2023
  
  a1c67e6d
- Fix return type error · 9e68a682
  Woosuk Kwon authored Feb 16, 2023
  
  9e68a682
- Add warning · 8edcabc7
  Woosuk Kwon authored Feb 16, 2023
  
  8edcabc7
- Fix KVCache shape · 2f4887de
  Woosuk Kwon authored Feb 16, 2023
  
  2f4887de
14 Feb, 2023 11 commits
- Add __repr__ · 3363c27d
  Woosuk Kwon authored Feb 14, 2023
  
  3363c27d
- Fix a ref count bug in swapping · 2729087e
  Woosuk Kwon authored Feb 14, 2023
  
  2729087e
- Fix double free · c128c2ed
  Woosuk Kwon authored Feb 14, 2023
  
  c128c2ed
- Minor · c80ed212
  Woosuk Kwon authored Feb 14, 2023
  
  c80ed212
- Minor · 263e91b3
  Woosuk Kwon authored Feb 14, 2023
  
  263e91b3
- Fix memory leak in swapping · be1e2163
  Woosuk Kwon authored Feb 14, 2023
  
  be1e2163
- Fix bugs in scheduler · 7e5f604e
  Woosuk Kwon authored Feb 14, 2023
  
  7e5f604e
- Fix a bug in swap_in and swap_out · 1f739f9b
  Woosuk Kwon authored Feb 14, 2023
  
  1f739f9b
- Fix can_swap_in · b1644f76
  Woosuk Kwon authored Feb 14, 2023
  
  b1644f76
- Fix typo · c574f195
  Woosuk Kwon authored Feb 14, 2023
  
  c574f195
- Fix typo · e40fa136
  Woosuk Kwon authored Feb 14, 2023
  
  e40fa136
13 Feb, 2023 3 commits
- Fix get_model · ee944251
  Woosuk Kwon authored Feb 13, 2023
  
  ee944251
- Fix typo · 531e1c74
  Woosuk Kwon authored Feb 13, 2023
  
  531e1c74
- Fix scheduler · d3d31766
  Woosuk Kwon authored Feb 13, 2023
  
  d3d31766