GitLab

适配w8a8 deepep,接入lightop版deepgemm

See merge request dcutoolkit/deeplearing/vllm!418

set fp8_e4m3 only supported on nmz and support q&kvcache fp8
set VLLM_PCIE_USE_CUSTOM_ALLREDUCE=1

[feat]支持宽松mtp

See merge request dcutoolkit/deeplearing/vllm!414

# Conflicts:
#	vllm/model_executor/layers/fused_moe/modular_kernel.py

# Conflicts:
#	vllm/model_executor/layers/fused_moe/config.py
#	vllm/model_executor/layers/fused_moe/layer.py
#	vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_marlin.py

Signed-off-by: Nick Hill <nickhill123@gmail.com>

Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>

[Bugfix] Disable RoutingMethodType.[Renormalize,RenormalizeNaive] TRTLLM per-tensor FP8 MoE (#33620)
Signed-off-by: mgoin <mgoin64@gmail.com>
(cherry picked from commit e346e2d0

)
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>