Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
10b67d86
Unverified
Commit
10b67d86
authored
Nov 08, 2024
by
bnellnm
Committed by
GitHub
Nov 08, 2024
Browse files
[Bugfix] SymIntArrayRef expected to contain concrete integers (#10170)
Signed-off-by:
Bill Nell
<
bill@neuralmagic.com
>
parent
4f93dfe9
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
vllm/compilation/backends.py
vllm/compilation/backends.py
+2
-1
No files found.
vllm/compilation/backends.py
View file @
10b67d86
...
...
@@ -329,6 +329,7 @@ class PiecewiseCompileInterpreter(torch.fx.Interpreter):
self
.
fake_mode
.
from_tensor
(
t
)
if
isinstance
(
t
,
torch
.
Tensor
)
else
t
for
t
in
args
]
with
self
.
fake_mode
:
return
super
().
run
(
*
fake_args
)
def
call_module
(
self
,
target
:
torch
.
fx
.
node
.
Target
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment