GitLab

Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>

更改默认的full _cuda_graph启动方式为false

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>

[Attention] Support multiple attention metadata builders per kv_cache_spec  + proper local attention no hybrid kv cache fix (#21588)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

This reverts commit c34fa0bf.

This reverts commit 33485749.

This reverts commit 93fae6b1.

This reverts commit edc45625.

Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>

Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>

Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>

Signed-off-by: luka <luka@neuralmagic.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: qizixi <qizixi@meta.com>

Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>

Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: Ronald Xu <ronaldxu@amazon.com>

Signed-off-by: qizixi <qizixi@meta.com>

Signed-off-by: qizixi <qizixi@meta.com>

Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Ronald Xu <ronaldxu@amazon.com>

Signed-off-by: Mark McLoughlin <markmc@redhat.com>

[V1][Spec Decode] Share input embedding of target model with EAGLE draft model to free ~1GB for llama 3 model (#17326)
Co-authored-by: root <root@ekagra-8xh100.us-east5-a.c.serving-efficiency-poc.internal>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>