Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Repository
"tests/v1/test_utils.py" did not exist on "8027a724611353d2ff3a504f91c5607e94f635b0"
395b1c74543053ebf25d4ab3af828cd145506caa
Switch branch/tag
vllm_cscc
vllm
entrypoints
openai
serving_completion.py
Find file
Blame
History
Permalink
[Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server (#10635)
· 395b1c74
tomeras91
authored
Nov 27, 2024
Signed-off-by:
Tomer Asida
<
tomera@ai21.com
>
395b1c74
serving_completion.py
21.7 KB
Edit
Web IDE
Replace serving_completion.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace serving_completion.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
Tomer Asida <tomera@ai21.com>