- 10 Sep, 2024 1 commit
-
-
drunkpig authored
* release: release 0.7.1 version (#526) * Update README_zh-CN.md (#404) (#409) correct FAQ url Co-authored-by:
sfk <18810651050@163.com> * add dockerfile (#189) Co-authored-by:
drunkpig <60862764+drunkpig@users.noreply.github.com> * Update cla.yml * Update cla.yml * feat<table model>: add tablemaster with paddleocr to detect and recognize table (#493) * Update cla.yml * Update bug_report.yml * Update README_zh-CN.md (#404) correct FAQ url * Update README_zh-CN.md (#404) (#409) (#410) correct FAQ url Co-authored-by:
Aoyang Fang <222010547@link.cuhk.edu.cn> Co-authored-by:
Xiaomeng Zhao <moe@myhloli.com> * <fix>(para_split_v2): index out of range issue of span_text first char (#396) Co-authored-by:
liukaiwen <liukaiwen@pjlab.org.cn> * @Matthijz98 has signed the CLA in opendatalab/MinerU#467 * Create download_models.py * Create requirements-docker.txt * feat<table model>: add tablemaster with paddleocr to detect and recognize table * @strongerfly has signed the CLA in opendatalab/MinerU#487 * feat<table model>: add tablemaster with paddleocr to detect and recognize table * feat<table model>: add tablemaster with paddleocr to detect and recognize table * feat<table model>: add tablemaster with paddleocr to detect and recognize table * feat<table model>: add tablemaster with paddleocr to detect and recognize table --------- Co-authored-by:
github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by:
yyy <102640628+dt-yy@users.noreply.github.com> Co-authored-by:
wangbinDL <wangbin_research@163.com> * feat<table model>: add tablemaster with paddleocr to detect and recognize table (#511) * Update cla.yml * Update bug_report.yml * Update README_zh-CN.md (#404) correct FAQ url * Update README_zh-CN.md (#404) (#409) (#410) correct FAQ url Co-authored-by:
Kaiwen Liu <lkw_buaa@163.com> Co-authored-by:
-
- 09 Sep, 2024 1 commit
-
-
Xiaomeng Zhao authored
-
- 02 Sep, 2024 1 commit
-
-
yyy authored
* feat<table model>: add tablemaster with paddleocr to detect and recognize table (#493) * Update cla.yml * Update bug_report.yml * Update README_zh-CN.md (#404) correct FAQ url * Update README_zh-CN.md (#404) (#409) (#410) correct FAQ url Co-authored-by:
-
- 28 Aug, 2024 1 commit
-
-
wangbinDL authored
-
- 26 Aug, 2024 1 commit
-
-
Siyu Hao authored
* upload an introduction about chemical formula * rename 2 files * update readme.md at TODO in chemstery * rename 2 files and update readme.md at TODO in chemstery * update README_zh-CN.md at TODO in chemstery
-
- 21 Aug, 2024 1 commit
-
-
Xiaomeng Zhao authored
-
- 20 Aug, 2024 2 commits
-
-
Xiaomeng Zhao authored
* fix(ocr_mkcontent): revise table caption output - Ensuring that table captions are properly included in the output. - Remove the redundant `table_caption` variable。 * Update cla.yml * Update bug_report.yml * feat(cli): add debug option for detailed error handling Enable users to invoke the CLI command with a new debug flag to get detailed debugging information. * fix(pdf-extract-kit): adjust crop_paste parameters for better accuracyThe crop_paste_x and crop_paste_y values in the pdf_extract_kit.py have been modified to improve the accuracy and consistency of OCR processing. The new values are set to 25 to ensure more precise image cropping and pasting which leads to better OCR recognition results. * Update README_zh-CN.md (#404) correct FAQ url * Update README_zh-CN.md (#404) (#409) (#410) correct FAQ url Co-authored-by:
-
icecraft authored
* feat: rename the file generated by command line tools * feat: add pdf filename as prefix to {span,layout,model}.pdf --------- Co-authored-by:icecraft <tmortred@gmail.com> Co-authored-by:
icecraft <xurui1@pjlab.org.cn>
-
- 13 Aug, 2024 3 commits
-
-
Xiaomeng Zhao authored
-
Xiaomeng Zhao authored
-
Xiaomeng Zhao authored
add new issue
-
- 10 Aug, 2024 1 commit
-
-
myhloli authored
Add FAQ entries in both English and Chinese to address the issue where the libGL.so.1 library is missing on Ubuntu22.04 when running under WSL2. The FAQ now includes instructions on how to install the missing library, resolvingthe corresponding ImportError.Closes https://github.com/opendatalab/MinerU/issues/388
-
- 09 Aug, 2024 7 commits
- 08 Aug, 2024 1 commit
-
-
myhloli authored
Add notes in the Ubuntu and Windows CUDA acceleration guides on how to determine if CUDA acceleration is working. This includes checking for significant reductions in `layout detection cost`, `mfr time`, and `ocr cost` as indicators of successful acceleration.
-
- 07 Aug, 2024 4 commits
-
-
myhloli authored
Add an exclamation mark to the section title to stress the importance of completing the additional steps after downloading a model. This change is made in the Chinese documentation to ensure users are aware of the necessary post-download actions.
-
myhloli authored
Adjust the print statement in the how_to_download_models_zh_cn.md guide to reflect the correct model download location. The path has been updated to specify the 'models' directory where the model is actually downloaded.
-
赵小蒙 authored
Add a print statement to the example code in 'how_to_download_models_zh_cn.md' to output the downloaded model directory path. This enhancement aids users in locating the model files as it provides a clear indication of where they are saved on the user's file system.
-
myhloli authored
docs(readme): update acknowledgment section and project description- Streamline the Acknowledgments section in the README by removing redundant entries.- Clarify the project's current use of PyMuPDF and future plans for exploring a more permissively licensed PDF processing library in the project description. - Ensure all modifications adhere to the project's documentation standards and improve reader understanding.
-
- 06 Aug, 2024 7 commits
-
-
myhloli authored
docs(models-download): update steps and remove deprecated sectionsUpdate the model download instructions to reflect the current process, removing unnecessary sections and simplifying the steps. The updated guide now includesclearer instructions on installing Git LFS, downloading models from Hugging Face,and additional checks for model file completeness. This change ensures that the documentation is up-to-date and provides a streamlined experience for users downloading models.
-
myhloli authored
docs: correct path format description in Windows CUDA docsUpdate the instructions in the Windows CUDA Acceleration documentation toreflect the correct path format. Specifically, clarify that Windows paths should include the drive letter and replace backslashes with forward slashes.
-
myhloli authored
-
myhloli authored
Update the URLs for downloading the `magic-pdf.template.json` and `small_ocr.pdf` files in the Windows CUDA acceleration guides. The links now point to the giteerepository instead of GitHub, ensuring users have access to the necessary files from the correct source.
-
myhloli authored
- Streamline the installation process by removing the redundant apt update step. - Adjust the numbering of installation steps throughout the document. - Update download URLs to gitee for the configuration template and demo file. - Ensure consistency in the model directory configuration advice.
-
myhloli authored
Add a new README_Ubuntu_CUDA_Acceleration_en_US.md document to provide users with a setup guide for enabling and testing CUDA acceleration on Ubuntu 22.04 LTS. The guideincludes steps to check and install NVIDIA drivers, install Anaconda, create a conda environment, install required applications, download and verify models, configure theenvironment, and test CUDA acceleration. This addition addresses the need for clear, concise instructions on achieving better performance with CUDA-enabled graphics cards and
-
myhloli authored
- Note the fix in version 0.6.2b1 for the network error during the first run of offline deployment and clarify the model download requirement. - Update the dependency installation guide for users on macOS with Intel CPUs. - Indicate the resolution in version 0.6.2b1 for compatibility issues with paddlepaddle version 2.6.1 on certain Linux systems. This change aims to make the FAQ more informative and easier to navigate for users experiencing similar issues, providing direct solutions and links where applicable.
-
- 05 Aug, 2024 1 commit
-
-
myhloli authored
Update the download links for Anaconda in both Ubuntu and Windows CUDA Acceleration documents to use the Tuna mirror. This change helps ensure that users in China have faster access to the Anaconda distribution.
-
- 02 Aug, 2024 8 commits
-
-
myhloli authored
Update the README documents to clarify that the "models-dir" in the configuration should be an absolute path. Also, provide additional guidance for Windows users on how to correctly format the path to avoid common issues with path escaping in JSON files.
-
myhloli authored
Add instructions to download the magic-pdf.template.json file using wget on Ubuntu and a PowerShell script on Windows in the respective README files. This is to facilitate the setup process by providing direct download options, replacing manual file transfers.
-
myhloli authored
Update the install commands in both Ubuntu and Windows CUDA Acceleration guides to specify Magic-PDF version 0.6.2b1, ensuring consistency andavoiding potential version mismatches.
-
myhloli authored
Update the FAQ to clarify the dependency installation issue when using magic-pdf. Ensure users are directed to install the specific version of magic-pdf that resolves the dependency error, rather than listing all individual dependencies. This simplifies the troubleshooting process and provides a direct solution for users encountering the "Required dependency not installed" error.
-
myhloli authored
Update the download methods for models in the Chinese documentation to reflect the latest options available from ModelScope. Simplify the section titles and revise download instructions for clarity and consistency.
-
myhloli authored
Update the documentation to reflect the latest model download procedures, emphasis on model file integrity checks, and expanded instructions for setting up CUDA accelerationon Ubuntu and Windows environments. The README files for various OS have been enhanced with additional details to assist users in configuring and verifying their environments for optimal performance.
-
xuchao authored
-
Kaiwen Liu authored
* # add table recognition using struct-eqtable ## Changelog 31/07/20204 - Support table recognition. Table images will be converted into html. ### how to use the new feature: set the attribute 'table-mode' to 'true' in magic-pdf.json ### caution: it takes 200s to 500s to convert a single table image using cpu * # add table recognition using struct-eqtable ## Changelog 31/07/20204 - Support table recognition. Table images will be converted into LaTex. ### how to use the new feature: set the attribute 'table-mode' to 'true' in magic-pdf.json ### caution: it takes 200s to 500s to convert a single table image using cpu * # feat(model inference): add table recognition and convertion to LaTeX # What's Changed ### New Features - Add table content recognition, we use weights of [StructEqTable](https://github.com/UniModal4Reasoning/StructEqTable-Deploy) to convert table image to LaTex. ### Instruction - pip install pypandoc struct-eqtable==0.1.0 - Download [StructEqTable weights](https://huggingface.co/wanderkid/PDF-Extract-Kit/tree/main/models/TabRec ) and put it under models/ directory. - Edit 'table-mode' value to turn on table recognition function which is turned off by default. - If you did not download any models before, refer to [how to download models](docs/how_to_download_models_zh_cn.md)。 * add table recognition and convertion to LaTeX * add table recognition and conversion to LaTeX * add table recognition and conversion to LaTeX * add table recognition and conversion to LaTeX --------- Co-authored-by:
-
