server/text_generation_server/models/flash_qwen2.py · c6bcadf883e7bd16fb74f509ba1dade1b635e96e · OpenDAS / text-generation-inference

refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) · 5da4cfab

Wang, Yi authored Jul 01, 2024



* refine get xpu free memory
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* enable qwen2 in xpu
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* enable gemma/gemma2/phi in intel platform
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

---------
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

5da4cfab

flash_qwen2.py 3.01 KB

Replace flash_qwen2.py