server/text_generation_server/layers/attention/ipex.py · 628334d33638709e7b0f91fbaaa290fec2d016f3 · OpenDAS / text-generation-inference

"test/vscode:/vscode.git/clone" did not exist on "35f95fe9b8a53927688b3ba0cbc234190b7a27c1"

hotfix: fix regression of attention api change in intel platform (#2439) · 5cd8025f

Wang, Yi authored Sep 05, 2024



fix regression caused by attention api change. ipex.varlen_attention does not support paged-cache
format kv input now.
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

5cd8025f

ipex.py 1.82 KB

Replace ipex.py