---
id: pr-flashinfer-2662
repo: flashinfer-ai/flashinfer
pr: 2662
title: 'fix: use current CUDA device instead of tp_rank for SymmDeviceMemory allocation'
author: fzyzcjy
date: '2026-03-24'
url: https://github.com/flashinfer-ai/flashinfer/pull/2662
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: b8931925fbda0b4a77a79ac4b6577a1da235f605
inclusion_reason: defer
changed_paths:
- flashinfer/comm/trtllm_ar.py
- flashinfer/comm/trtllm_mnnvl_ar.py
- tests/comm/test_trtllm_allreduce_fusion.py
artifact_dir: evidence/pull-bundles/flashinfer/gh-2662
head_ref_oid: 0c80eba568247d3be132ddaad69ad0207c65e58e
---
# fix: use current CUDA device instead of tp_rank for SymmDeviceMemory allocation

- Repository: `flashinfer-ai/flashinfer`
- PR: [2662](https://github.com/flashinfer-ai/flashinfer/pull/2662)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `flashinfer/comm/trtllm_ar.py`
- `flashinfer/comm/trtllm_mnnvl_ar.py`
- `tests/comm/test_trtllm_allreduce_fusion.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2662`
