Skip to content

GitLab

Commit 5880e08c authored by wanglch's avatar wanglch
Browse files

Update infernece_FinGPT.py

parent e9a3ef66
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
infernece_FinGPT.py
View file @ 5880e08c
...@@ -5,7 +5,7 @@ from transformers import AutoTokenizer, AutoModel ...@@ -5,7 +5,7 @@ from transformers import AutoTokenizer, AutoModel
import readline import readline
base_model = '/home/wanglch/projects/FinGPT/FinGPT_mt_chatglm2-6b-merged' base_model = '../FinGPT/FinGPT_mt_chatglm2-6b-merged'
tokenizer = AutoTokenizer.from_pretrained(base_model, trust_remote_code=True) tokenizer = AutoTokenizer.from_pretrained(base_model, trust_remote_code=True)
model = AutoModel.from_pretrained(base_model, trust_remote_code=True, device_map = "auto") model = AutoModel.from_pretrained(base_model, trust_remote_code=True, device_map = "auto")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment