Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Repository
d0de006f0c0fbf1b2e4a737e9ce9752fb8375eea
Switch branch/tag
vllm_cscc
vllm
worker
model_runner.py
Find file
Blame
History
Permalink
[feat]添加VLLM_ENFORCE_EAGER_BS_THRESHOLD环境变量，支持cudagraph模式下，当bs大于阈值时，强制切换为eager模式，对大bs有效果
· 3ce3e3d9
王敏
authored
Apr 15, 2025
3ce3e3d9
model_runner.py
88.9 KB
Edit
Web IDE
Replace model_runner.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace model_runner.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
