Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
wangsen
MinerU
Commits
05c6f0b1
Commit
05c6f0b1
authored
Jul 01, 2025
by
myhloli
Browse files
fix: improve block filtering and cleanup in para_split.py
parent
fefe2d36
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
6 deletions
+6
-6
mineru/backend/pipeline/para_split.py
mineru/backend/pipeline/para_split.py
+6
-6
No files found.
mineru/backend/pipeline/para_split.py
View file @
05c6f0b1
...
@@ -365,12 +365,12 @@ def para_split(page_info_list):
...
@@ -365,12 +365,12 @@ def para_split(page_info_list):
for
page_info
in
page_info_list
:
for
page_info
in
page_info_list
:
page_info
[
'para_blocks'
]
=
[]
page_info
[
'para_blocks'
]
=
[]
for
block
in
all_blocks
:
for
block
in
all_blocks
:
if
block
[
'page_num'
]
==
page_info
[
'page_idx'
]
:
if
'page_num'
in
block
:
page_info
[
'para_blocks'
].
append
(
block
)
if
block
[
'page_num'
]
==
page_info
[
'page_idx'
]:
page_info
[
'para_blocks'
].
append
(
block
)
# 从block中删除不需要的page_num和page_size字段
# 从block中删除不需要的page_num和page_size字段
del
block
[
'page_num'
]
del
block
[
'page_num'
]
del
block
[
'page_size'
]
del
block
[
'page_size'
]
if
__name__
==
'__main__'
:
if
__name__
==
'__main__'
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment