Skip to content

GitLab

Commit e80e947e authored by chenych's avatar chenych
Browse files

Add packages

parent e08c9060
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
config.ini
View file @ e80e947e
......@@ -10,7 +10,7 @@ embedding_model_path=/path/to/your/text2vec-large-chinese
reranker_model_path=/path/to/your/bce-reranker-base_v1
[llm]
local_llm_path=/path/to/your/internlm-chat-7b
use_vllm=False
stream_chat=False
local_llm_path=/home/llama3/Llama3-8B-Chinese-Chat
use_vllm=True
stream_chat=True
tensor_parallel_size=1
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment