- 27 Sep, 2024 1 commit
-
-
sfk authored
update backlog
-
- 26 Sep, 2024 1 commit
-
-
unknown authored
-
- 12 Sep, 2024 1 commit
-
-
myhloli authored
-
- 10 Sep, 2024 3 commits
-
-
Xiaomeng Zhao authored
-
drunkpig authored
* release: release 0.7.1 version (#526) * Update README_zh-CN.md (#404) (#409) correct FAQ url Co-authored-by:
sfk <18810651050@163.com> * add dockerfile (#189) Co-authored-by:
drunkpig <60862764+drunkpig@users.noreply.github.com> * Update cla.yml * Update cla.yml * feat<table model>: add tablemaster with paddleocr to detect and recognize table (#493) * Update cla.yml * Update bug_report.yml * Update README_zh-CN.md (#404) correct FAQ url * Update README_zh-CN.md (#404) (#409) (#410) correct FAQ url Co-authored-by:
Aoyang Fang <222010547@link.cuhk.edu.cn> Co-authored-by:
Xiaomeng Zhao <moe@myhloli.com> * <fix>(para_split_v2): index out of range issue of span_text first char (#396) Co-authored-by:
liukaiwen <liukaiwen@pjlab.org.cn> * @Matthijz98 has signed the CLA in opendatalab/MinerU#467 * Create download_models.py * Create requirements-docker.txt * feat<table model>: add tablemaster with paddleocr to detect and recognize table * @strongerfly has signed the CLA in opendatalab/MinerU#487 * feat<table model>: add tablemaster with paddleocr to detect and recognize table * feat<table model>: add tablemaster with paddleocr to detect and recognize table * feat<table model>: add tablemaster with paddleocr to detect and recognize table * feat<table model>: add tablemaster with paddleocr to detect and recognize table --------- Co-authored-by:
github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by:
yyy <102640628+dt-yy@users.noreply.github.com> Co-authored-by:
wangbinDL <wangbin_research@163.com> * feat<table model>: add tablemaster with paddleocr to detect and recognize table (#511) * Update cla.yml * Update bug_report.yml * Update README_zh-CN.md (#404) correct FAQ url * Update README_zh-CN.md (#404) (#409) (#410) correct FAQ url Co-authored-by:
Kaiwen Liu <lkw_buaa@163.com> Co-authored-by:
-
drunkpig authored
* Update README_zh-CN.md (#404) (#409) correct FAQ url Co-authored-by:
icecraft <tmortred@gmail.com> Co-authored-by:
icecraft <xurui1@pjlab.org.cn> * fix(ocr_mkcontent): revise table caption output (#397) * fix(ocr_mkcontent): revise table caption output - Ensuring that table captions are properly included in the output. - Remove the redundant `table_caption` variable。 * Update cla.yml * Update bug_report.yml * feat(cli): add debug option for detailed error handling Enable users to invoke the CLI command with a new debug flag to get detailed debugging information. * fix(pdf-extract-kit): adjust crop_paste parameters for better accuracyThe crop_paste_x and crop_paste_y values in the pdf_extract_kit.py have been modified to improve the accuracy and consistency of OCR processing. The new values are set to 25 to ensure more precise image cropping and pasting which leads to better OCR recognition results. * Update README_zh-CN.md (#404) correct FAQ url * Update README_zh-CN.md (#404) (#409) (#410) correct FAQ url Co-authored-by:
quyuan <quyuan@pjlab.org> * Update cla.yml * Update gpu-ci.yml * Update cli.yml * Delete .github/workflows/gpu-ci.yml * fix(pdf-parse-union-core): #492 decrease span threshold for block filling (#500) Reduce the span threshold used in fill_spans_in_blocks from 0.6 to 0.3 to improve the accuracy of block filling based on layout analysis. * fix(detect_all_bboxes): remove small overlapping blocks by merging (#501) Previously, small blocks that overlapped with larger ones were merely removed. This fix changes the approach to merge smaller blocks into the larger block instead, ensuring that no information is lost and the larger block encompasses all the text content fully. * feat(cli&analyze&pipeline): add start_page and end_page args for pagination (#507) * feat(cli&analyze&pipeline): add start_page and end_page args for paginationAdd start_page_id and end_page_id arguments to various components of the PDF parsing pipeline to support pagination functionality. This feature allows users to specify the range of pages to be processed, enhancing the efficiency and flexibility of the system. * feat(cli&analyze&pipeline): add start_page and end_page args for paginationAdd start_page_id and end_page_id arguments to various components of the PDF parsing pipeline to support pagination functionality. This feature allows users to specify the range of pages to be processed, enhancing the efficiency and flexibility of the system. * feat(cli&analyze&pipeline): add start_page and end_page args for paginationAdd start_page_id and end_page_id arguments to various components of the PDF parsing pipeline to support pagination functionality. This feature allows users to specify the range of pages to be processed, enhancing the efficiency and flexibility of the system. * Feat/support rag (#510) * Create requirements-docker.txt * feat: update deps to support rag * feat: add support to rag, add rag_data_reader api for rag integration * feat: let user retrieve the filename of the processed file * feat: add projects demo for rag integrations --------- Co-authored-by:
icecraft <tmortred@163.com> Co-authored-by:
Siyu Hao <131659128+GDDGCZ518@users.noreply.github.com> Co-authored-by:
-
- 09 Sep, 2024 1 commit
-
-
Kaiwen Liu authored
* fix: resolve inaccuracy of drawing layout box caused by paragraphs combination * fix: resolve inaccuracy of drawing layout box caused by paragraphs combination #384 * fix: resolve inaccuracy of drawing layout box caused by paragraphs combination #384 * fix: resolve inaccuracy of drawing layout box caused by paragraphs combination #384 * Update README.md * Update README_zh-CN.md * Update README_zh-CN.md add HF、modelscope、colab url * Update README.md * Update README.md * Update README.md * Update README.md * Update README_zh-CN.md * Rename README.md to README_zh-CN.md * Create readme.md * Rename readme.md to README.md * Rename README.md to README_zh-CN.md * Update README_zh-CN.md * Create README.md * Update README.md * Update README.md * Update README.md * Update README_zh-CN.md * Update README.md * Update README_zh-CN.md * Update README_zh-CN.md * Update README.md * Update README_zh-CN.md * fix: resolve inaccuracy of drawing layout box caused by paragraphs combination #384 --------- Co-authored-by:
-
- 02 Sep, 2024 4 commits
-
-
sfk authored
* release: release 0.7.1 version (#526) * Update README_zh-CN.md (#404) (#409) correct FAQ url Co-authored-by:
-
sfk authored
* Update README.md * Update README_zh-CN.md * Update README_zh-CN.md
-
yyy authored
* feat<table model>: add tablemaster with paddleocr to detect and recognize table (#493) * Update cla.yml * Update bug_report.yml * Update README_zh-CN.md (#404) correct FAQ url * Update README_zh-CN.md (#404) (#409) (#410) correct FAQ url Co-authored-by:
-
yyy authored
* Update README_zh-CN.md (#404) (#409) correct FAQ url Co-authored-by:
-
- 26 Aug, 2024 1 commit
-
-
Siyu Hao authored
* upload an introduction about chemical formula * rename 2 files * update readme.md at TODO in chemstery * rename 2 files and update readme.md at TODO in chemstery * update README_zh-CN.md at TODO in chemstery
-
- 22 Aug, 2024 1 commit
-
-
Xiaomeng Zhao authored
* build(docker): update base image to Ubuntu 22.04 and install PaddlePaddleUpgrade the Docker base image from ubuntu:latest to ubuntu:22.04 for improved performance and stability. Additionally, integrate PaddlePaddle GPU version 3.0.0b1 into the Docker build for enhanced AI capabilities. The MinIO configuration file has also been updated to the latest version. * build(dockerfile): Updated the Dockerfile * build(Dockerfile): update Dockerfile * docs(docker): add instructions for quick deployment with Docker Include Docker-based deployment instructions in the README for both English and Chinese locales. This update provides users a quick-start guide to using Docker for deployment, with notes on GPU VRAM requirements and default acceleration features. * build(docker): Layer the installation of dependencies, downloading the model, and the setup of the program itself. * build(docker): Layer the installation of dependencies, downloading the model, and the setup of the program itself.
-
- 20 Aug, 2024 1 commit
-
-
icecraft authored
* feat: rename the file generated by command line tools * feat: add pdf filename as prefix to {span,layout,model}.pdf --------- Co-authored-by:
-
- 09 Aug, 2024 1 commit
-
-
xuchao authored
-
- 08 Aug, 2024 1 commit
-
-
ZuanZuan authored
-
- 01 Aug, 2024 2 commits
-
-
myhloli authored
-
myhloli authored
Reorganize the installation instructions for Magic-PDF to clarify the dependency on detectron2 and provide a more straightforward installation process. The update includes separating the dependency installation from the package installation and adding a note about precompiled wheels for Python 3.10. BREAKING CHANGE: The installation guide now assumes basic familiarity with detectron2 installation requirements. Users who need to compile detectron2 from source should refer to the official detectron2 documentation.
-
- 31 Jul, 2024 4 commits
-
-
myhloli authored
Update the PyTorch installation command in the README files for both English and Chinese versions to reflect the required version compatibility with CUDA 11.8. Include explicit instructions to specify the PyTorch version to avoid automatic installation of higher, unsupported versions. Additionally, clarify the importance of modifying the "device-mode" parameter in the magic-pdf.json configuration file for proper CUDA device selection.
-
myhloli authored
Update the PyTorch installation guide in both English and Chinese READMEs to explicitly recommend using torch==2.3.1 and torchvision==0.18.1 for CUDA 11.8. Emphasize the importance of specifying these versions to avoid compatibility issues with higher, unsupported versions.
-
xuchao authored
-
myhloli authored
We have pre-released the 0.6.2 beta version, which addresses numerous issues reported in our logs. This commit updates the installation guide in the README to include information on how to install this beta version. Users are advised that this build has not undergone full QA testing and may contain issues. A revert instruction to version 0.6.1 is also provided for users who encounter problems. BREAKING CHANGE: Installation instructions now include beta version information. Users should be aware of potential issues with the0.6.2 beta version and consider reverting to 0.6.1 if necessary.
-
- 29 Jul, 2024 2 commits
-
-
赵小蒙 authored
-
Conghui He authored
-
- 28 Jul, 2024 2 commits
-
-
Ikko Eltociear Ashimine authored
I created Japanese translated README.
-
drunkpig authored
-
- 26 Jul, 2024 1 commit
-
-
徐超 authored
-
- 23 Jul, 2024 3 commits
-
-
qiangqiang199 authored
超链接格式完善
-
qiangqiang199 authored
文章末尾新增友情链接，便于labelllm、labelu仓库引流
-
Xiaomeng Zhao authored
-
- 22 Jul, 2024 1 commit
-
-
myhloli authored
-
- 19 Jul, 2024 2 commits
- 15 Jul, 2024 2 commits
- 13 Jul, 2024 3 commits
-
-
myhloli authored
-
myhloli authored
-
Xiaomeng Zhao authored
-
- 12 Jul, 2024 2 commits
