GitLab

* async inference support

* implemented concurrent decorator

* fixes for Python versions < 3.7

* async methods depend on python version

* revert changes in forward method

* async_test -> async_simple_test, debug logging is done via logger.debug

* add async test

* add asynctest to test requirements

* async tests are run in Python 3.7

* check CUDA, add docs

* fix device

* run test only if CUDA is available

* fix linting

* custom operators can run on nondefault stream

* set current stream in kernel launch configuration

* example fixes

* add async/sync interface comparison benchmark

* fix linting

* fix the imports in __init__.py

* update contribution guide

* update the high-level inference api

* save classes in meta data and use it for visualization