Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
4b4dc132
Unverified
Commit
4b4dc132
authored
Oct 08, 2025
by
Liangsheng Yin
Committed by
GitHub
Oct 08, 2025
Browse files
Rename `ngram_utils` -> `ngram_info` (#11316)
parent
5a9170d9
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
2 additions
and
3 deletions
+2
-3
python/sglang/srt/model_executor/cuda_graph_runner.py
python/sglang/srt/model_executor/cuda_graph_runner.py
+1
-1
python/sglang/srt/speculative/ngram_info.py
python/sglang/srt/speculative/ngram_info.py
+0
-0
python/sglang/srt/speculative/ngram_worker.py
python/sglang/srt/speculative/ngram_worker.py
+1
-1
python/sglang/srt/speculative/spec_utils.py
python/sglang/srt/speculative/spec_utils.py
+0
-1
No files found.
python/sglang/srt/model_executor/cuda_graph_runner.py
View file @
4b4dc132
...
@@ -849,7 +849,7 @@ class CudaGraphRunner:
...
@@ -849,7 +849,7 @@ class CudaGraphRunner:
)
)
elif
self
.
model_runner
.
spec_algorithm
.
is_ngram
():
elif
self
.
model_runner
.
spec_algorithm
.
is_ngram
():
from
sglang.srt.speculative.ngram_
utils
import
NgramVerifyInput
from
sglang.srt.speculative.ngram_
info
import
NgramVerifyInput
spec_info
=
NgramVerifyInput
(
spec_info
=
NgramVerifyInput
(
draft_token
=
None
,
draft_token
=
None
,
...
...
python/sglang/srt/speculative/ngram_
utils
.py
→
python/sglang/srt/speculative/ngram_
info
.py
View file @
4b4dc132
File moved
python/sglang/srt/speculative/ngram_worker.py
View file @
4b4dc132
...
@@ -11,7 +11,7 @@ from sglang.srt.managers.tp_worker import TpModelWorker
...
@@ -11,7 +11,7 @@ from sglang.srt.managers.tp_worker import TpModelWorker
from
sglang.srt.model_executor.forward_batch_info
import
ForwardMode
from
sglang.srt.model_executor.forward_batch_info
import
ForwardMode
from
sglang.srt.server_args
import
ServerArgs
from
sglang.srt.server_args
import
ServerArgs
from
sglang.srt.speculative.cpp_ngram.ngram_cache
import
NgramCache
from
sglang.srt.speculative.cpp_ngram.ngram_cache
import
NgramCache
from
sglang.srt.speculative.ngram_
utils
import
NgramVerifyInput
from
sglang.srt.speculative.ngram_
info
import
NgramVerifyInput
from
sglang.srt.speculative.spec_info
import
SpeculativeAlgorithm
from
sglang.srt.speculative.spec_info
import
SpeculativeAlgorithm
logger
=
logging
.
getLogger
(
__name__
)
logger
=
logging
.
getLogger
(
__name__
)
...
...
python/sglang/srt/speculative/spec_utils.py
View file @
4b4dc132
from
__future__
import
annotations
from
__future__
import
annotations
import
logging
import
logging
import
os
import
time
import
time
from
typing
import
TYPE_CHECKING
,
List
from
typing
import
TYPE_CHECKING
,
List
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment