Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Lmdeploy
Commits
7bc8d171
Unverified
Commit
7bc8d171
authored
Jul 27, 2023
by
MaxMatthew
Committed by
GitHub
Jul 27, 2023
Browse files
add model_name param for chatbot (#174)
parent
b9004712
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
lmdeploy/serve/turbomind/chatbot.py
lmdeploy/serve/turbomind/chatbot.py
+4
-1
No files found.
lmdeploy/serve/turbomind/chatbot.py
View file @
7bc8d171
...
...
@@ -71,13 +71,16 @@ class Chatbot:
def
__init__
(
self
,
tritonserver_addr
:
str
,
model_name
:
str
=
''
,
ignore_eos
:
bool
=
False
,
log_level
:
int
=
logging
.
INFO
,
display
:
bool
=
False
,
profile_generation
:
bool
=
False
,
profile_serving
:
bool
=
False
):
self
.
tritonserver_addr
=
tritonserver_addr
self
.
model_name
=
self
.
_get_model_name
()
self
.
model_name
=
model_name
if
self
.
model_name
==
''
:
self
.
model_name
=
self
.
_get_model_name
()
assert
self
.
model_name
in
MODELS
.
module_dict
.
keys
(),
\
f
"'
{
self
.
model_name
}
' is not supported. "
\
f
'The supported models are:
{
MODELS
.
module_dict
.
keys
()
}
'
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment