Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
53976fce
"vscode:/vscode.git/clone" did not exist on "22d7f924076d7ca9f49b478821d0d8af167ec9a8"
Unverified
Commit
53976fce
authored
Sep 02, 2025
by
ykwd
Committed by
GitHub
Sep 02, 2025
Browse files
[Hicache] Generic page get bugfix (#9909)
parent
18f91eb6
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
7 deletions
+8
-7
python/sglang/srt/managers/cache_controller.py
python/sglang/srt/managers/cache_controller.py
+8
-7
No files found.
python/sglang/srt/managers/cache_controller.py
View file @
53976fce
...
...
@@ -659,13 +659,14 @@ class HiCacheController:
f
"Prefetch operation
{
operation
.
request_id
}
failed to retrieve page
{
hash_values
[
i
]
}
."
)
break
if
operation
.
increment
(
self
.
page_size
):
self
.
mem_pool_host
.
set_from_flat_data_page
(
host_indices
[
i
*
self
.
page_size
],
page_data
[
i
],
)
else
:
break
# Must set the data before increasing the completed tokens.
# Otherwise this page may be read before being set.
self
.
mem_pool_host
.
set_from_flat_data_page
(
host_indices
[
i
*
self
.
page_size
],
page_data
[
i
],
)
if
not
operation
.
increment
(
self
.
page_size
):
break
# Operation terminated by controller
def
_page_transfer
(
self
,
operation
):
# Select the get function and batch size
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment