vllm/model_executor/models/falcon_h1.py · 20bd6f4d2ee10d6187d93e4bc6a64f78195243a2 · OpenDAS / vllm_cscc

[FalconH1] Fix output dtype in RMSNorm fallback path for Falcon-H1 (e.g. 0.5B) (#18500) · 20bd6f4d

Dhia Eddine Rhaiem authored May 22, 2025


Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>

20bd6f4d

falcon_h1.py 26.2 KB

Replace falcon_h1.py