index.rst

Welcome to LMDeploy's tutorials!
====================================

.. _get_started:
.. toctree::
   :maxdepth: 2
   :caption: Get Started

   get_started.md

.. _build:
.. toctree::
   :maxdepth: 1
   :caption: Build

   build.md

.. _benchmark:
.. toctree::
   :maxdepth: 1
   :caption: Benchmark

   benchmark/profile_generation.md
   benchmark/profile_throughput.md
   benchmark/profile_api_server.md
   benchmark/profile_triton_server.md
   benchmark/evaluate_with_opencompass.md

.. _supported_models:
.. toctree::
   :maxdepth: 1
   :caption: Supported Models

   supported_models/supported_models.md

.. _inference:
.. toctree::
   :maxdepth: 1
   :caption: Inference

   inference/pipeline.md
   inference/vl_pipeline.md


.. _serving:
.. toctree::
   :maxdepth: 1
   :caption: serving

   serving/api_server.md
   serving/api_server_vl.md
   serving/gradio.md
   serving/proxy_server.md

.. _quantization:
.. toctree::
   :maxdepth: 1
   :caption: Quantization

   quantization/w4a16.md
   quantization/kv_int8.md
   quantization/w8a8.md

.. toctree::
   :maxdepth: 1
   :caption: Advanced Guide

   inference/turbomind.md
   inference/pytorch.md
   advance/pytorch_new_model.md
   advance/long_context.md
   advance/chat_template.md
   advance/debug_turbomind.md
   serving/qos.md

.. toctree::
   :maxdepth: 1
   :caption: API Reference

   api/pipeline.rst

Indices and tables
==================

* :ref:`genindex`
* :ref:`search`