Commits · 1066cbd152fb7c9a096e914a10ce675a14796b92 · kecinstone / 2024pra-vllm · GitLab

20 Dec, 2023 1 commit
- Make _prepare_sample non-blocking and use pinned memory for input buffers (#2207) · 31bff691
  Hanzhi Zhou authored Dec 19, 2023
  
  31bff691
19 Dec, 2023 1 commit
- Add warning on CUDA graph memory usage (#2182) · 21d5daa4
  Woosuk Kwon authored Dec 18, 2023
  
  21d5daa4
17 Dec, 2023 2 commits
- Remove dependency on CuPy (#2152) · c3372e87
  Woosuk Kwon authored Dec 17, 2023
  
  c3372e87
- Optimize model execution with CUDA graph (#1926) · 37ca5581
  Woosuk Kwon authored Dec 16, 2023
```
Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  37ca5581
13 Dec, 2023 1 commit
- [BugFix] Fix input positions for long context with sliding window (#2088) · f1c85201
  Woosuk Kwon authored Dec 13, 2023
  
  f1c85201
03 Dec, 2023 1 commit
- Fix broken sampler tests (#1896) · 5f09cbdb
  Woosuk Kwon authored Dec 02, 2023
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  5f09cbdb
30 Nov, 2023 1 commit
- Refactor Worker & InputMetadata (#1843) · 27feead2
  Woosuk Kwon authored Nov 29, 2023
  
  27feead2