GitLab

Signed-off-by: Max de Bayser <mbayser@br.ibm.com>

Co-authored-by: youkaichao <youkaichao@126.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

Co-authored-by: Michael Goin <michael@neuralmagic.com>

Co-authored-by: ElizaWszola <eliza@neuralmagic.com>

Co-authored-by: Nick Hill <nickhill@us.ibm.com>

[BUG] fix crash on flashinfer backend with cudagraph disabled, when attention group_size not in [1,2,4,8] (#7509)

Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Fei <dfdfcai4@gmail.com>

Co-authored-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>

Co-authored-by: Michael Goin <michael@neuralmagic.com>

Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>

Co-authored-by: Nick Hill <nickhill@us.ibm.com>

[Core] Fix tracking of model forward time to the span traces in case of PP>1 (#7440)