Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dgl
Commits
bf8f05df
Unverified
Commit
bf8f05df
authored
Feb 01, 2024
by
Muhammed Fatih BALIN
Committed by
GitHub
Feb 01, 2024
Browse files
[GraphBolt][CUDA] Use deque instead of Queue for Bufferer. (#7050)
parent
e117adac
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
8 deletions
+8
-8
python/dgl/graphbolt/dataloader.py
python/dgl/graphbolt/dataloader.py
+8
-8
No files found.
python/dgl/graphbolt/dataloader.py
View file @
bf8f05df
"""Graph Bolt DataLoaders"""
from
queue
import
Que
ue
from
collections
import
deq
ue
import
torch
import
torch.utils.data
...
...
@@ -69,18 +69,18 @@ class Bufferer(dp.iter.IterDataPipe):
raise
ValueError
(
"'buffer_size' is required to be a positive integer."
)
self
.
buffer
=
Queue
(
buffer_size
)
self
.
buffer
=
deque
(
maxlen
=
buffer_size
)
def
__iter__
(
self
):
for
data
in
self
.
datapipe
:
if
not
self
.
buffer
.
full
()
:
self
.
buffer
.
put
(
data
)
if
len
(
self
.
buffer
)
<
self
.
buffer
.
maxlen
:
self
.
buffer
.
append
(
data
)
else
:
return_data
=
self
.
buffer
.
ge
t
()
self
.
buffer
.
put
(
data
)
return_data
=
self
.
buffer
.
poplef
t
()
self
.
buffer
.
append
(
data
)
yield
return_data
while
not
self
.
buffer
.
empty
()
:
yield
self
.
buffer
.
ge
t
()
while
len
(
self
.
buffer
)
>
0
:
yield
self
.
buffer
.
poplef
t
()
class
Awaiter
(
dp
.
iter
.
IterDataPipe
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment