1. 04 Jan, 2026 1 commit
    • laibao's avatar
      perf: 加速 v1 InputBatch.add_request 的 token_ids 拷贝 · fbe8587a
      laibao authored
      新增环境变量开关 VLLM_V1_FAST_TOKEN_ID_COPY(默认关闭)。开启后在 CachedRequestState 中缓存 prompt_token_ids 的 np.int32,并在 add_request 里用 np.copyto 写入 token_ids_cpu,避免长 prompt 场景反复 list->NumPy 转换开销(尤其是抢占/反复进出 batch 时)
      fbe8587a
  2. 26 Dec, 2025 1 commit
  3. 25 Dec, 2025 1 commit
  4. 24 Dec, 2025 2 commits
  5. 23 Dec, 2025 1 commit
  6. 22 Dec, 2025 1 commit
  7. 19 Dec, 2025 2 commits
  8. 18 Dec, 2025 3 commits
  9. 17 Dec, 2025 4 commits
  10. 16 Dec, 2025 2 commits
  11. 09 Dec, 2025 1 commit
  12. 08 Dec, 2025 2 commits
  13. 05 Dec, 2025 2 commits
  14. 04 Dec, 2025 1 commit
  15. 02 Dec, 2025 1 commit
  16. 01 Dec, 2025 3 commits
  17. 27 Nov, 2025 7 commits
  18. 26 Nov, 2025 2 commits
  19. 23 Nov, 2025 1 commit
  20. 21 Nov, 2025 1 commit
  21. 20 Nov, 2025 1 commit