Commit 90321855 authored by myhloli's avatar myhloli
Browse files

build(dependencies): update PyMuPDF, pydantic and transformers

- Update PyMuPDF to version <1.25.0
- Update pydantic to version <2.11
- Update transformers to version < 5.0.0
- Remove always_apply parameter from alb.ToGray in image processing
parent d09464be
boto3>=1.28.43 boto3>=1.28.43
Brotli>=1.1.0 Brotli>=1.1.0
click>=8.1.7 click>=8.1.7
PyMuPDF>=1.24.9,<=1.24.14 PyMuPDF>=1.24.9,<1.25.0
loguru>=0.6.0 loguru>=0.6.0
numpy>=1.21.6,<2.0.0 numpy>=1.21.6,<2.0.0
fast-langdetect>=0.2.3,<0.3.0 fast-langdetect>=0.2.3,<0.3.0
...@@ -15,3 +15,5 @@ rapid-table>=1.0.3,<2.0.0 ...@@ -15,3 +15,5 @@ rapid-table>=1.0.3,<2.0.0
doclayout-yolo==0.0.2b1 doclayout-yolo==0.0.2b1
ftfy ftfy
openai openai
pydantic>=2.7.2,<2.11
transformers>=4.49.0,<5.0.0
\ No newline at end of file
boto3>=1.28.43 boto3>=1.28.43
Brotli>=1.1.0 Brotli>=1.1.0
click>=8.1.7 click>=8.1.7
PyMuPDF>=1.24.9,<=1.24.14 PyMuPDF>=1.24.9,<1.25.0
loguru>=0.6.0 loguru>=0.6.0
numpy>=1.21.6,<2.0.0 numpy>=1.21.6,<2.0.0
fast-langdetect>=0.2.3,<0.3.0 fast-langdetect>=0.2.3,<0.3.0
...@@ -15,3 +15,5 @@ rapid-table>=1.0.3,<2.0.0 ...@@ -15,3 +15,5 @@ rapid-table>=1.0.3,<2.0.0
doclayout-yolo==0.0.2b1 doclayout-yolo==0.0.2b1
ftfy ftfy
openai openai
pydantic>=2.7.2,<2.11
transformers>=4.49.0,<5.0.0
\ No newline at end of file
boto3>=1.28.43 boto3>=1.28.43
Brotli>=1.1.0 Brotli>=1.1.0
click>=8.1.7 click>=8.1.7
PyMuPDF>=1.24.9,<=1.24.14 PyMuPDF>=1.24.9,<1.25.0
loguru>=0.6.0 loguru>=0.6.0
numpy>=1.21.6,<2.0.0 numpy>=1.21.6,<2.0.0
fast-langdetect>=0.2.3,<0.3.0 fast-langdetect>=0.2.3,<0.3.0
...@@ -15,3 +15,5 @@ rapid-table>=1.0.3,<2.0.0 ...@@ -15,3 +15,5 @@ rapid-table>=1.0.3,<2.0.0
doclayout-yolo==0.0.2b1 doclayout-yolo==0.0.2b1
ftfy ftfy
openai openai
pydantic>=2.7.2,<2.11
transformers>=4.49.0,<5.0.0
\ No newline at end of file
...@@ -16,7 +16,7 @@ class UnimerSwinImageProcessor(BaseImageProcessor): ...@@ -16,7 +16,7 @@ class UnimerSwinImageProcessor(BaseImageProcessor):
self.transform = alb.Compose( self.transform = alb.Compose(
[ [
alb.ToGray(always_apply=True), alb.ToGray(),
alb.Normalize((0.7931, 0.7931, 0.7931), (0.1738, 0.1738, 0.1738)), alb.Normalize((0.7931, 0.7931, 0.7931), (0.1738, 0.1738, 0.1738)),
# alb.Sharpen() # alb.Sharpen()
ToTensorV2(), ToTensorV2(),
......
...@@ -4,11 +4,11 @@ click>=8.1.7 ...@@ -4,11 +4,11 @@ click>=8.1.7
fast-langdetect>=0.2.3,<0.3.0 fast-langdetect>=0.2.3,<0.3.0
loguru>=0.6.0 loguru>=0.6.0
numpy>=1.21.6 numpy>=1.21.6
pydantic>=2.7.2 pydantic>=2.7.2,<2.11
PyMuPDF>=1.24.9,<=1.24.14 PyMuPDF>=1.24.9,<1.25.0
scikit-learn>=1.0.2 scikit-learn>=1.0.2
torch>=2.2.2,!=2.5.0,!=2.5.1,<=2.6.0 torch>=2.2.2,!=2.5.0,!=2.5.1,<=2.6.0
torchvision torchvision
transformers>=4.49.0 transformers>=4.49.0,<5.0.0
pdfminer.six==20231228 pdfminer.six==20231228
# The requirements.txt must ensure that only necessary external dependencies are introduced. If there are new dependencies to add, please contact the project administrator. # The requirements.txt must ensure that only necessary external dependencies are introduced. If there are new dependencies to add, please contact the project administrator.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment