Merge branch 'v0.9.2-dev_bugfix' into 'v0.9.2-dev'
bugfix: Fix the startup crash issue of the service when USE_FUSED_RMS_QUANT=1 See merge request dcutoolkit/deeplearing/vllm!344
Showing
Please register or sign in to comment
bugfix: Fix the startup crash issue of the service when USE_FUSED_RMS_QUANT=1 See merge request dcutoolkit/deeplearing/vllm!344