Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
83ea5c72
Unverified
Commit
83ea5c72
authored
Oct 10, 2024
by
Ilya Lavrenov
Committed by
GitHub
Oct 10, 2024
Browse files
[OpenVINO] Use torch 2.4.0 and newer optimim version (#9121)
Co-authored-by:
DarkLight1337
<
tlleungac@connect.ust.hk
>
parent
04de9057
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
5 deletions
+5
-5
requirements-openvino.txt
requirements-openvino.txt
+5
-5
No files found.
requirements-openvino.txt
View file @
83ea5c72
# Common dependencies
-r requirements-common.txt
# OpenVINO dependencies
torch >= 2.1.2
openvino ~= 2024.4.0
op
envino-tokenizers[transformers] ~= 2024.4.0
optimum-intel[
openvino] >= 1.19.0
torch == 2.4.0 # should be aligned with "common" vLLM torch version
openvino >= 2024.4.0 # since 2024.4.0 both CPU and GPU support Paged Attention
op
timum @ git+https://github.com/huggingface/optimum.git@main # latest optimum is used to support latest transformers version
optimum-intel[
nncf] @ git+https://github.com/huggingface/optimum-intel.git@main # latest optimum-intel is used to support latest transformers version
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment