---
id: pr-vllm-20930
repo: vllm-project/vllm
pr: 20930
title: '[Model] Pooling models default to using chunked prefill & prefix caching if supported.'
author: noooop
date: '2025-08-11'
url: https://github.com/vllm-project/vllm/pull/20930
source_category: upstream-code
architectures:
- sm100
tags:
- gemm
- prefill
techniques: []
hardware_features: []
kernel_types:
- gemm
- prefill
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 84cf78acee1e75bfa163863b3674aeb3ba266844
inclusion_reason: kernel file changes
changed_paths:
- tests/entrypoints/llm/test_classify.py
- tests/entrypoints/openai/test_classification.py
- tests/models/language/pooling/mteb_utils.py
- tests/models/language/pooling/test_auto_prefix_cache_support.py
- tests/models/language/pooling/test_baai.py
- tests/models/language/pooling/test_bge_reranker_v2_gemma.py
- tests/models/language/pooling/test_cross_encoder.py
- tests/models/language/pooling/test_gte.py
- tests/models/language/pooling/test_intfloat.py
- tests/models/language/pooling/test_jina.py
- tests/models/language/pooling/test_mxbai_rerank.py
- tests/models/language/pooling/test_nomic.py
- tests/models/language/pooling/test_qwen3_reranker.py
- tests/models/language/pooling/test_snowflake_arctic_embed.py
- tests/models/utils.py
- tests/test_config.py
- vllm/config/__init__.py
- vllm/engine/arg_utils.py
- vllm/entrypoints/llm.py
- vllm/model_executor/layers/pooler.py
- vllm/model_executor/models/adapters.py
- vllm/model_executor/models/bert.py
- vllm/model_executor/models/bert_with_rope.py
- vllm/model_executor/models/interfaces.py
- vllm/model_executor/models/internlm2.py
- vllm/model_executor/models/jamba.py
- vllm/model_executor/models/modernbert.py
- vllm/model_executor/models/qwen2_rm.py
- vllm/model_executor/models/registry.py
- vllm/model_executor/models/roberta.py
- vllm/v1/worker/gpu_model_runner.py
head_ref_oid: 9552a49d13dbb331134a82c51c00653e4e4f9ba9
artifact_dir: evidence/pull-bundles/vllm/gh-20930
---
# [Model] Pooling models default to using chunked prefill & prefix caching if supported.

- Repository: `vllm-project/vllm`
- PR: [20930](https://github.com/vllm-project/vllm/pull/20930)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `tests/entrypoints/llm/test_classify.py`
- `tests/entrypoints/openai/test_classification.py`
- `tests/models/language/pooling/mteb_utils.py`
- `tests/models/language/pooling/test_auto_prefix_cache_support.py`
- `tests/models/language/pooling/test_baai.py`
- `tests/models/language/pooling/test_bge_reranker_v2_gemma.py`
- `tests/models/language/pooling/test_cross_encoder.py`
- `tests/models/language/pooling/test_gte.py`
- `tests/models/language/pooling/test_intfloat.py`
- `tests/models/language/pooling/test_jina.py`
- `tests/models/language/pooling/test_mxbai_rerank.py`
- `tests/models/language/pooling/test_nomic.py`
- `tests/models/language/pooling/test_qwen3_reranker.py`
- `tests/models/language/pooling/test_snowflake_arctic_embed.py`
- `tests/models/utils.py`
- `tests/test_config.py`
- `vllm/config/__init__.py`
- `vllm/engine/arg_utils.py`
- `vllm/entrypoints/llm.py`
- `vllm/model_executor/layers/pooler.py`
- `vllm/model_executor/models/adapters.py`
- `vllm/model_executor/models/bert.py`
- `vllm/model_executor/models/bert_with_rope.py`
- `vllm/model_executor/models/interfaces.py`
- `vllm/model_executor/models/internlm2.py`
- `vllm/model_executor/models/jamba.py`
- `vllm/model_executor/models/modernbert.py`
- `vllm/model_executor/models/qwen2_rm.py`
- `vllm/model_executor/models/registry.py`
- `vllm/model_executor/models/roberta.py`
- `vllm/v1/worker/gpu_model_runner.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-20930`
