README.rst

..
  # Copyright (c) 2019-2021, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
  #
  # Redistribution and use in source and binary forms, with or without
  # modification, are permitted provided that the following conditions
  # are met:
  #  * Redistributions of source code must retain the above copyright
  #    notice, this list of conditions and the following disclaimer.
  #  * Redistributions in binary form must reproduce the above copyright
  #    notice, this list of conditions and the following disclaimer in the
  #    documentation and/or other materials provided with the distribution.
  #  * Neither the name of NVIDIA CORPORATION nor the names of its
  #    contributors may be used to endorse or promote products derived
  #    from this software without specific prior written permission.
  #
  # THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
  # EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
  # IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
  # PURPOSE ARE DISCLAIMED.  IN NO EVENT SHALL THE COPYRIGHT OWNER OR
  # CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
  # EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
  # PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
  # PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
  # OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
  # (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
  # OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

|License|

Generate Go Client stubs
==========================

To generate the stubs::

  # Clone the repo containing the proto definitions, from within client/src/grpc_generated/go/
  git clone https://github.com/triton-inference-server/common.git

  # Compiles *.proto to *.pb.go
  ./gen_go_stubs.sh

Example Go Client
=================

To run the grpc client example::

  # Clone the repo containing the example model, from within client/src/grpc_generated/go/.
  git clone https://github.com/triton-inference-server/server.git

  # Setup "simple" model from example model_repository
  cd server/docs/examples
  ./fetch_models.sh

  # Launch (detached) Triton
  docker run -d -p8000:8000 -p8001:8001 -p8002:8002 -it -v $(pwd)/model_repository:/models nvcr.io/nvidia/tritonserver:22.11-py3 tritonserver --model-store=/models
  
  # Use client
  cd ../../../
  go run grpc_simple_client.go

Sample Output::

  $ go run grpc_simple_client.go
    FLAGS: {simple  1 localhost:8001}
    Triton Health - Live: true
    Triton Health - Ready: true
    name:"simple"  versions:"1"  platform:"tensorflow_graphdef"  inputs:{name:"INPUT0"  datatype:"INT32"  shape:-1  shape:16}  inputs:{name:"INPUT1"  datatype:"INT32"  shape:-1  shape:16}  outputs:{name:"OUTPUT0"  datatype:"INT32"  shape:-1  shape:16}  outputs:{name:"OUTPUT1"  datatype:"INT32"  shape:-1  shape:16}
    
    Checking Inference Outputs
    --------------------------
    0 + 1 = 1
    0 - 1 = -1
    1 + 1 = 2
    1 - 1 = 0
    2 + 1 = 3
    2 - 1 = 1
    3 + 1 = 4
    3 - 1 = 2
    4 + 1 = 5
    4 - 1 = 3
    5 + 1 = 6
    5 - 1 = 4
    6 + 1 = 7
    6 - 1 = 5
    7 + 1 = 8
    7 - 1 = 6
    8 + 1 = 9
    8 - 1 = 7
    9 + 1 = 10
    9 - 1 = 8
    10 + 1 = 11
    10 - 1 = 9
    11 + 1 = 12
    11 - 1 = 10
    12 + 1 = 13
    12 - 1 = 11
    13 + 1 = 14
    13 - 1 = 12
    14 + 1 = 15
    14 - 1 = 13
    15 + 1 = 16
    15 - 1 = 14

.. |License| image:: https://img.shields.io/badge/License-BSD3-lightgrey.svg
   :target: https://opensource.org/licenses/BSD-3-Clause