---
id: pr-tensorrt-llm-12046
repo: NVIDIA/TensorRT-LLM
pr: 12046
title: '[https://nvbugs/5955188][fix] Fix harmony parsers and WAR routing PDL for agentic coding use cases'
author: dongfengy
date: '2026-03-13'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/12046
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark_test
- moe_routing
- routing
- scheduler_autotune
techniques:
- autotuning
- tile-scheduling
hardware_features:
- pdl
kernel_types:
- moe
- scheduler
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 69787a93f124f839c2755a052274cea0101d4416
inclusion_reason: Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.
changed_paths:
- cpp/tensorrt_llm/common/envUtils.cpp
- cpp/tensorrt_llm/common/envUtils.h
- cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/runner.cu
- jenkins/L0_Test.groovy
- tensorrt_llm/executor/postproc_worker.py
- tensorrt_llm/executor/result.py
- tensorrt_llm/serve/harmony_adapter.py
- tensorrt_llm/serve/openai_server.py
- tensorrt_llm/serve/postprocess_handlers.py
- tests/unittest/llmapi/test_executor.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-12046
head_ref_oid: 9b53ae24b362c7bcc75e256b1a8d9a1365171af6
---
# [https://nvbugs/5955188][fix] Fix harmony parsers and WAR routing PDL for agentic coding use cases

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [12046](https://github.com/NVIDIA/TensorRT-LLM/pull/12046)
- Decision: `Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.`
- Reason: Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.

## Changed Paths

- `cpp/tensorrt_llm/common/envUtils.cpp`
- `cpp/tensorrt_llm/common/envUtils.h`
- `cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/runner.cu`
- `jenkins/L0_Test.groovy`
- `tensorrt_llm/executor/postproc_worker.py`
- `tensorrt_llm/executor/result.py`
- `tensorrt_llm/serve/harmony_adapter.py`
- `tensorrt_llm/serve/openai_server.py`
- `tensorrt_llm/serve/postprocess_handlers.py`
- `tests/unittest/llmapi/test_executor.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-12046`
