server/text_generation_server/models/flash_mistral.py · b64c70c9e7a2a416117cb6b317cb85e5d679717a · OpenDAS / text-generation-inference

"vscode:/vscode.git/clone" did not exist on "8ad700f735c48bb9627f1d8ea21d5d44561777f5"

Cpu tgi (#1936) · b64c70c9

Wang, Yi authored Jun 25, 2024



* add CPU tgi support
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* ipex distributed ops support
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

---------
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Funtowicz Morgan <mfuntowicz@users.noreply.github.com>

b64c70c9

flash_mistral.py 3.99 KB

Replace flash_mistral.py