Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Repository
ebf778061db4e67c6903f8d6e8ad97c3db0174d8
Switch branch/tag
vllm_cscc
vllm
engine
llm_engine.py
Find file
Blame
History
Permalink
monitor metrics of tokens per step using cudagraph batchsizes (#11031)
· ebf77806
youkaichao
authored
Dec 09, 2024
Signed-off-by:
youkaichao
<
youkaichao@gmail.com
>
ebf77806
llm_engine.py
87.5 KB
Edit
Web IDE
Replace llm_engine.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace llm_engine.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
youkaichao <youkaichao@gmail.com>