tests/v1/attention/test_trtllm_attention_integration.py · 577df69b26491aaa8f3fef2ea44d6ac256172032 · OpenDAS / vllm_cscc

[Bugfix] Fix KV scales inconsistency in fp8 MLA & FlashInfer kv_cache_dtype... · 577df69b

Andy Lo authored Mar 18, 2026


[Bugfix] Fix KV scales inconsistency in fp8 MLA & FlashInfer kv_cache_dtype "auto" leading to gibberish (#37054)
Signed-off-by: Andy Lo <andy@mistral.ai>

577df69b

test_trtllm_attention_integration.py 11.3 KB

Replace test_trtllm_attention_integration.py