components/src/dynamo/trtllm/request_handlers/handler_base.py · 98d0ce91b8c7ff0fceefe705a0b308ab158528af · OpenDAS / dynamo · GitLab

Find file Blame History Permalink

feat: Support a dynamic default max_tokens for TensorRT-LLM backend (#5152) · 98d0ce91
Steven Murr authored Mar 27, 2026
```
Signed-off-by: Steven Murr <stevemurr@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
98d0ce91

handler_base.py 44 KB