pipeline.rst

inference pipeline
==================
.. currentmodule:: lmdeploy

pipeline
--------
.. autofunction:: pipeline

serving
--------
.. autofunction:: serve
.. autofunction:: client


PytorchEngineConfig
-------------------
.. autoclass:: PytorchEngineConfig


TurbomindEngineConfig
---------------------
.. autoclass:: TurbomindEngineConfig


GenerationConfig
----------------
.. autoclass:: GenerationConfig


ChatTemplateConfig
------------------
.. autoclass:: ChatTemplateConfig