Skip to content

GitLab

Commit 0262f954 authored by liam's avatar liam
Browse files

Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktransformers into feat-DeepSeekV3

parents 3dca28d2 027b1126
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
ktransformers/local_chat.py
View file @ 0262f954
...@@ -81,8 +81,10 @@ def local_chat(): ...@@ -81,8 +81,10 @@ def local_chat():
content = "hi" content = "hi"
else: else:
content = open(config.prompt_file, "r").read() content = open(config.prompt_file, "r").read()
print("User: ", content)
elif os.path.isfile(content): elif os.path.isfile(content):
content = open(content, "r").read() content = open(content, "r").read()
print("User: ", content)
messages = his_content + [{"role": "user", "content": content}] messages = his_content + [{"role": "user", "content": content}]
async def async_inference(messages): async def async_inference(messages):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment