• drbh's avatar
    implement Open Inference Protocol endpoints (#1942) · f433f1f7
    drbh authored
    * feat: add kserve feature and basic routes
    
    * feat: implement infer endpoint wrapper around generate
    
    * fix: refactor and improve types
    
    * fix: improve infer and simplify
    
    * fix: cleanup and improve api docs
    
    * fix: refactor and encapsulate kserve feat in file
    
    * fix: remove typos after rebase
    f433f1f7
lib.rs 43.1 KB