Skip to content

GitLab

Commit 72fa11c7 authored by shihm's avatar shihm
Browse files

updata inference

parent 61f51a8e
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
inference.py
View file @ 72fa11c7
from transformers import AutoTokenizer, AutoModelForCausalLM from transformers import AutoTokenizer, AutoModelForCausalLM
import os import os
import torch import torch
model_path = "/baichuan-inc/Baichuan-M3-235B" model_path = "baichuan-inc/Baichuan-M3-235B"
os.environ['TRANSFORMERS_OFFLINE'] = '1' os.environ['TRANSFORMERS_OFFLINE'] = '1'
os.environ['MODELSCOPE_OFFLINE'] = '1' os.environ['MODELSCOPE_OFFLINE'] = '1'
model = AutoModelForCausalLM.from_pretrained( model = AutoModelForCausalLM.from_pretrained(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment