GitLab

[Core] Fix tracking of model forward time to the span traces in case of PP>1 (#7440)

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Co-authored-by: Mor Zusman <morz@ai21.com>

[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

Support pipeline-parallelism with Ray accelerated DAG.
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>

Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>

[Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend and update documentation  (#6125)

Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

Co-authored-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>

Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Stephanie Wang <swang@cs.berkeley.edu>

Co-authored-by: Michael Goin <michael@neuralmagic.com>