Unverified Commit cd687233 authored by Cody Yu's avatar Cody Yu Committed by GitHub
Browse files

Fix Mistral model loading (#108)


Co-authored-by: default avatarjohndun <dunavent.jm@gmail.com>
parent 81561f8e
"""Inference-only Mistral model."""
from sglang.srt.models.llama2 import LlamaForCausalLM
class MistralForCausalLM(LlamaForCausalLM):
def __init__(self, *args, **kwargs):
super().__init__(*args, **kwargs)
EntryClass = MistralForCausalLM
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment