Commits · d11bf435a0bfdefece204aa6a725e849dc00d8cb · OpenDAS / vllm_cscc · GitLab

18 Oct, 2024 2 commits
- [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) · d11bf435
  Cody Yu authored Oct 18, 2024
  
  d11bf435
- [Bugfix][Core] Use torch.cuda.memory_stats() to profile peak memory usage (#9352) · de4008e2
  Joe Runde authored Oct 17, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  de4008e2
24 Aug, 2024 1 commit
- [misc][core] lazy import outlines (#7831) · 7d9ffa2a
  youkaichao authored Aug 24, 2024
  
  7d9ffa2a