1. 18 Mar, 2026 1 commit
    • laibao's avatar
      feat(moe): 增加 LightOP moe_sum+mul+add 融合并打通参数透传 · 0639678c
      laibao authored
        新增环境变量 VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD 用于控制
        fused sum+mul+add 开关。
        在 DeepseekV2MoE 中增加 fused 路径,预计算 shared_output,并下传 iqis 与 routed_scaling_factor。
        扩展 FusedMoE/SharedFusedMoE 及相关 custom op 接口,统一透传 i_q/i_s/shared_output/routed_scaling_factor。
        同步适配 Triton、Marlin W16A16、SlimQuant W4A8、CompressedTensors W8A8 等实现,支持在内核侧完成 sum+mul+add。
      0639678c
  2. 17 Mar, 2026 1 commit
  3. 16 Mar, 2026 3 commits
  4. 15 Mar, 2026 1 commit
    • fanwl's avatar
      Add FA Unified Attention 2D · eb35ba1b
      fanwl authored
      - Add VLLM_V1_USE_FA_UNIFIED_ATTN_2D 环境变量
      - 0: Triton attention, 1: FA unified attention
      eb35ba1b
  5. 13 Mar, 2026 3 commits
  6. 12 Mar, 2026 8 commits
  7. 11 Mar, 2026 3 commits
  8. 10 Mar, 2026 2 commits
  9. 09 Mar, 2026 1 commit
  10. 07 Mar, 2026 1 commit
  11. 06 Mar, 2026 3 commits
  12. 05 Mar, 2026 3 commits
  13. 04 Mar, 2026 1 commit
  14. 03 Mar, 2026 1 commit
  15. 02 Mar, 2026 2 commits
  16. 28 Feb, 2026 1 commit
  17. 25 Feb, 2026 1 commit
  18. 24 Feb, 2026 2 commits
  19. 19 Feb, 2026 1 commit
  20. 16 Feb, 2026 1 commit