:orphan:

Tutorials
=========



.. raw:: html

    <div class="sphx-glr-thumbnails">


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Introduction ------------">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_pruning_speedup_thumb.png
    :alt: Speedup Model with Mask

  :ref:`sphx_glr_tutorials_pruning_speedup.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Speedup Model with Mask</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip=" Introduction ------------">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_quantization_speedup_thumb.png
    :alt: SpeedUp Model with Calibration Config

  :ref:`sphx_glr_tutorials_quantization_speedup.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">SpeedUp Model with Calibration Config</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Here is a four-minute video to get you started with model quantization.">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_quantization_quick_start_mnist_thumb.png
    :alt: Quantization Quickstart

  :ref:`sphx_glr_tutorials_quantization_quick_start_mnist.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Quantization Quickstart</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Here is a three-minute video to get you started with model pruning.">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_pruning_quick_start_mnist_thumb.png
    :alt: Pruning Quickstart

  :ref:`sphx_glr_tutorials_pruning_quick_start_mnist.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Pruning Quickstart</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="To write a new quantization algorithm, you can write a class that inherits nni.compression.pyto...">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_quantization_customize_thumb.png
    :alt: Customize a new quantization algorithm

  :ref:`sphx_glr_tutorials_quantization_customize.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Customize a new quantization algorithm</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="In this tutorial, we show how to use NAS Benchmarks as datasets. For research purposes we somet...">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_nasbench_as_dataset_thumb.png
    :alt: Use NAS Benchmarks as Datasets

  :ref:`sphx_glr_tutorials_nasbench_as_dataset.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Use NAS Benchmarks as Datasets</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Users can easily customize a basic pruner in NNI. A large number of basic modules have been pro...">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_pruning_customize_thumb.png
    :alt: Customize Basic Pruner

  :ref:`sphx_glr_tutorials_pruning_customize.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Customize Basic Pruner</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This is the 101 tutorial of Neural Architecture Search (NAS) on NNI. In this tutorial, we will ...">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_hello_nas_thumb.png
    :alt: Hello, NAS!

  :ref:`sphx_glr_tutorials_hello_nas.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Hello, NAS!</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="In this tutorial, we demonstrate how to search in the famous model space proposed in `DARTS`_.">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_darts_thumb.png
    :alt: Searching in DARTS search space

  :ref:`sphx_glr_tutorials_darts.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Searching in DARTS search space</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Workable Pruning Process ------------------------">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_pruning_bert_glue_thumb.png
    :alt: Pruning Transformer with NNI

  :ref:`sphx_glr_tutorials_pruning_bert_glue.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Pruning Transformer with NNI</div>
    </div>


.. raw:: html

    </div>


.. toctree::
   :hidden:

   /tutorials/pruning_speedup
   /tutorials/quantization_speedup
   /tutorials/quantization_quick_start_mnist
   /tutorials/pruning_quick_start_mnist
   /tutorials/quantization_customize
   /tutorials/nasbench_as_dataset
   /tutorials/pruning_customize
   /tutorials/hello_nas
   /tutorials/darts
   /tutorials/pruning_bert_glue




.. raw:: html

    <div class="sphx-glr-thumbnails">


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="The tutorial consists of 4 steps: ">

.. only:: html

  .. image:: /tutorials/hpo_quickstart_pytorch/images/thumb/sphx_glr_main_thumb.png
    :alt: HPO Quickstart with PyTorch

  :ref:`sphx_glr_tutorials_hpo_quickstart_pytorch_main.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">HPO Quickstart with PyTorch</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="It can be run directly and will have the exact same result as original version.">

.. only:: html

  .. image:: /tutorials/hpo_quickstart_pytorch/images/thumb/sphx_glr_model_thumb.png
    :alt: Port PyTorch Quickstart to NNI

  :ref:`sphx_glr_tutorials_hpo_quickstart_pytorch_model.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Port PyTorch Quickstart to NNI</div>
    </div>


.. raw:: html

    </div>




.. raw:: html

    <div class="sphx-glr-thumbnails">


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="The tutorial consists of 4 steps: ">

.. only:: html

  .. image:: /tutorials/hpo_quickstart_tensorflow/images/thumb/sphx_glr_main_thumb.png
    :alt: HPO Quickstart with TensorFlow

  :ref:`sphx_glr_tutorials_hpo_quickstart_tensorflow_main.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">HPO Quickstart with TensorFlow</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="It can be run directly and will have the exact same result as original version.">

.. only:: html

  .. image:: /tutorials/hpo_quickstart_tensorflow/images/thumb/sphx_glr_model_thumb.png
    :alt: Port TensorFlow Quickstart to NNI

  :ref:`sphx_glr_tutorials_hpo_quickstart_tensorflow_model.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Port TensorFlow Quickstart to NNI</div>
    </div>


.. raw:: html

    </div>


.. toctree::
   :hidden:
   :includehidden:

   /tutorials/hpo_quickstart_pytorch/index.rst
   /tutorials/hpo_quickstart_tensorflow/index.rst



.. only:: html

 .. rst-class:: sphx-glr-signature

    `Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_