src/turbomind/utils/allocator.h · 0cc667e1fd1c994b262453b1a15076203ac834ef · OpenDAS / Lmdeploy · GitLab

Find file Blame History Permalink

[feature] Graceful termination of background threads in LlamaV2 (#458) · 0cc667e1
akhoroshev authored Sep 26, 2023
```
* cuda allocator fix

* graceful termination

* lint and compilation fix
```
0cc667e1

allocator.h 15.1 KB