server/text_generation_server/utils/import_utils.py · b64c70c9e7a2a416117cb6b317cb85e5d679717a · OpenDAS / text-generation-inference

"vscode:/vscode.git/clone" did not exist on "e114d8748673a067324e0809479273d522a614e1"

Cpu tgi (#1936) · b64c70c9

Wang, Yi authored Jun 25, 2024



* add CPU tgi support
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* ipex distributed ops support
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

---------
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Funtowicz Morgan <mfuntowicz@users.noreply.github.com>

b64c70c9

import_utils.py 1.98 KB

Replace import_utils.py