欢迎来到 LMDeploy 的中文教程！
====================================


.. _快速上手:
.. toctree::
   :maxdepth: 2
   :caption: 快速上手

   get_started.md

.. _编译和安装:
.. toctree::
   :maxdepth: 1
   :caption: 编译和安装

   build.md

.. _测试基准:
.. toctree::
   :maxdepth: 1
   :caption: 测试基准

   benchmark/profile_generation.md
   benchmark/profile_throughput.md
   benchmark/profile_api_server.md
   benchmark/profile_triton_server.md
   benchmark/evaluate_with_opencompass.md

.. _支持的模型:
.. toctree::
   :maxdepth: 1
   :caption: 模型列表

   supported_models/supported_models.md

.. _推理:
.. toctree::
   :maxdepth: 1
   :caption: 推理

   inference/pipeline.md
   inference/vl_pipeline.md


.. _服务:
.. toctree::
   :maxdepth: 1
   :caption: 服务

   serving/api_server.md
   serving/api_server_vl.md
   serving/gradio.md
   serving/proxy_server.md


.. _量化:
.. toctree::
   :maxdepth: 1
   :caption: 量化

   quantization/w4a16.md
   quantization/kv_int8.md
   quantization/w8a8.md

.. toctree::
   :maxdepth: 1
   :caption: 进阶指南

   inference/turbomind.md
   inference/pytorch.md
   advance/pytorch_new_model.md
   advance/long_context.md
   advance/chat_template.md
   advance/debug_turbomind.md
   serving/qos.md

.. toctree::
   :maxdepth: 1
   :caption: API 文档

   api/pipeline.rst

索引与表格
==================

* :ref:`genindex`
* :ref:`search`