Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
003f8ee1
Unverified
Commit
003f8ee1
authored
Aug 05, 2024
by
Nick Hill
Committed by
GitHub
Aug 05, 2024
Browse files
[BugFix] Use IP4 localhost form for zmq bind (#7163)
parent
e9630458
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
vllm/entrypoints/openai/rpc/server.py
vllm/entrypoints/openai/rpc/server.py
+3
-1
No files found.
vllm/entrypoints/openai/rpc/server.py
View file @
003f8ee1
...
...
@@ -30,7 +30,9 @@ class AsyncEngineRPCServer:
# Init socket for readiness state.
self
.
socket
=
self
.
context
.
socket
(
zmq
.
constants
.
ROUTER
)
self
.
socket
.
bind
(
f
"tcp://localhost:
{
port
}
"
)
# Note numeric form of localhost should be used for zmq bind(),
# see https://stackoverflow.com/a/8958414
self
.
socket
.
bind
(
f
"tcp://127.0.0.1:
{
port
}
"
)
def
cleanup
(
self
):
"""Cleanup all resources."""
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment