tests/tensorizer_loader/test_tensorizer.py · 03dccc886ef7e5d0dd67512f3e9748ee00c21fb2 · OpenDAS / vllm_cscc

[Frontend] [Core] Support for sharded tensorized models (#4990) · 51602eef

Travis Johnson authored Jun 12, 2024


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

51602eef

test_tensorizer.py 11.9 KB

Replace test_tensorizer.py