"vscode:/vscode.git/clone" did not exist on "7c600440f7560348e571f021f2b2d1469de5264d"
Unverified Commit 83ea5c72 authored by Ilya Lavrenov's avatar Ilya Lavrenov Committed by GitHub
Browse files

[OpenVINO] Use torch 2.4.0 and newer optimim version (#9121)


Co-authored-by: default avatarDarkLight1337 <tlleungac@connect.ust.hk>
parent 04de9057
# Common dependencies
-r requirements-common.txt
# OpenVINO dependencies
torch >= 2.1.2
openvino ~= 2024.4.0
openvino-tokenizers[transformers] ~= 2024.4.0
optimum-intel[openvino] >= 1.19.0
torch == 2.4.0 # should be aligned with "common" vLLM torch version
openvino >= 2024.4.0 # since 2024.4.0 both CPU and GPU support Paged Attention
optimum @ git+https://github.com/huggingface/optimum.git@main # latest optimum is used to support latest transformers version
optimum-intel[nncf] @ git+https://github.com/huggingface/optimum-intel.git@main # latest optimum-intel is used to support latest transformers version
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment