Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
8711d03d
"...python/git@developer.sourcefind.cn:change/sglang.git" did not exist on "60b0503227d01fbeb21a9ad270445d38229611c1"
Commit
8711d03d
authored
Apr 22, 2024
by
Daniel Hiltgen
Browse files
Report errors on server lookup instead of path lookup failure
parent
6e8db047
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
0 deletions
+6
-0
llm/server.go
llm/server.go
+6
-0
No files found.
llm/server.go
View file @
8711d03d
...
@@ -253,6 +253,12 @@ func NewLlamaServer(model string, adapters, projectors []string, opts api.Option
...
@@ -253,6 +253,12 @@ func NewLlamaServer(model string, adapters, projectors []string, opts api.Option
var
finalErr
error
var
finalErr
error
for
i
:=
0
;
i
<
len
(
servers
);
i
++
{
for
i
:=
0
;
i
<
len
(
servers
);
i
++
{
dir
:=
availableServers
[
servers
[
i
]]
dir
:=
availableServers
[
servers
[
i
]]
if
dir
==
""
{
// Shouldn't happen
finalErr
=
fmt
.
Errorf
(
"[%d] server %s not listed in available servers %v"
,
i
,
servers
[
i
],
availableServers
)
slog
.
Error
(
"sever list inconsistent"
,
"error"
,
finalErr
)
continue
}
// Find an availableServers port, retry on each iterration in case the failure was a port conflict race
// Find an availableServers port, retry on each iterration in case the failure was a port conflict race
port
:=
0
port
:=
0
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment