• AllentDan's avatar
    Improve api_server and webui usage (#544) · 373bd013
    AllentDan authored
    * make IPv6 compatible, safe run for coroutine interrupting
    
    * instance_id -> session_id and fix api_client.py
    
    * update doc
    
    * remove useless faq
    
    * safe ip mapping
    
    * update app.py
    
    * WIP completion
    
    * completion
    
    * update doc
    
    * disable interactive mode for /v1/chat/completions
    
    * docstring
    
    * docstring
    
    * refactor gradio
    
    * update gradio
    
    * udpate
    
    * update doc
    
    * rename
    
    * session_id default -1
    
    * missed two files
    
    * add a APIClient
    
    * add chat func for APIClient
    
    * refine
    
    * add concurrent function
    
    * sequence_start, sequence_end --> interactive_mode
    
    * update doc
    
    * comments
    
    * doc
    
    * better text completion
    
    * remove /v1/embeddings
    
    * comments
    
    * deprecate generate and use /v1/interactive/completions
    
    * /v1/interactive/completion -> /v1/chat/interactive
    
    * embeddings
    
    * rename
    
    * remove wrong arg description
    
    * docstring
    
    * fix
    
    * update cli
    
    * update doc
    
    * strict session_len limit condition
    
    * pass model args to api_server
    373bd013
README.md 9.22 KB