• AllentDan's avatar
    Add Restful API (#223) · d5c10e7a
    AllentDan authored
    * add restful api
    
    * refine
    
    * add simple doc
    
    * lint
    
    * add uvicorn requirement
    
    * more args
    
    * add llama2
    
    * docstring
    
    * update doc
    
    * save
    
    * refine
    
    * lint
    
    * better decode
    
    * add v1/embedding
    
    * add GenerateRequest
    
    * add llama2 chat template
    
    * correct profiling
    
    * update documents
    
    * add length judge
    
    * add faq
    
    * update doc and rename req_que to req_queue
    
    * fix md link, use get_logger, fix sequence_end bug
    
    * use another doc link for go to avoid lint error
    
    * add api_client.py
    
    * update doc
    
    * update doc
    
    * update function interface
    
    * update FAQ
    
    * resolve comments
    d5c10e7a
api_client.py 2.46 KB