1. 22 Jan, 2026 1 commit
  2. 21 Jan, 2026 1 commit
    • laibao's avatar
      perf(qwen3): 融合 q/k RMSNorm + RoPE · 7cd7bf8a
      laibao authored
      新增 VLLM_USE_FUSED_RMS_ROPE 分支,走 fused 路径
      注册 torch.ops.vllm.rms_rotary_embedding_fuse(direct_register_custom_op)
      cos_sin_cache 自动转 device/dtype 并缓存,避免每次重复拷贝
      7cd7bf8a
  3. 16 Jan, 2026 2 commits
    • zhuwenwen's avatar
      add VLLM_USE_FUSED_CACHE_QUANT_BMM_MLA to use fused rmsnorm + contiguous +... · 9dd70f0e
      zhuwenwen authored
      add VLLM_USE_FUSED_CACHE_QUANT_BMM_MLA to use fused rmsnorm + contiguous + rope(for dpsk-v3) + concat_and_cache_mla + q quant, control bmm(todo) + cat +mla (fp8)
      9dd70f0e
    • laibao's avatar
      MoE 路由抓取:新增 router_capture 工具链与 envs 统一配置 · a2f0ce42
      laibao authored
      新增环境变量 VLLM_MOE_ROUTER_CAPTURE / DIR / RANK / MAX_LAYERS / NUM_TOKENS_* 用于开关与过滤控制
      新增 router_capture.py,支持按 num_tokens 分桶抓取 router logits 并落盘
      在 qwen3_moe 中接入抓取逻辑,默认关闭,仅在开启时记录
      固定 skip_profile / skip_stack_funcs 为默认启用,避免抓到 warmup/profile 形状
      统一配置入口到 vllm.envs,作为运行时基准
      a2f0ce42
  4. 15 Jan, 2026 2 commits
  5. 12 Jan, 2026 2 commits
  6. 08 Jan, 2026 1 commit
  7. 07 Jan, 2026 1 commit
  8. 05 Jan, 2026 2 commits
  9. 04 Jan, 2026 1 commit
  10. 23 Dec, 2025 2 commits
  11. 22 Dec, 2025 3 commits
  12. 20 Dec, 2025 1 commit
  13. 18 Dec, 2025 2 commits
  14. 17 Dec, 2025 1 commit
  15. 16 Dec, 2025 2 commits
  16. 15 Dec, 2025 1 commit
  17. 14 Dec, 2025 1 commit
  18. 10 Dec, 2025 1 commit
  19. 08 Dec, 2025 1 commit
  20. 04 Dec, 2025 1 commit
  21. 02 Dec, 2025 2 commits
  22. 01 Dec, 2025 1 commit
  23. 26 Nov, 2025 1 commit
  24. 20 Nov, 2025 2 commits
  25. 18 Nov, 2025 1 commit
  26. 13 Nov, 2025 3 commits
  27. 12 Nov, 2025 1 commit