vllm/model_executor/model_loader/neuron.py · ad385667103b7a98fee5a4fc46d2a7745407333e · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Hardware][Neuron] Add on-device sampling support for Neuron (#8746) · cc90419e
Chongming Ni authored Oct 04, 2024
```
Co-authored-by: Ashraf Mahgoub <ashymahg@amazon.com>
```
cc90419e

neuron.py 9.41 KB