GitLab

docs(ascend): 更新文档说明，增加docker运行前的环境要求

- 在文档中明确指出，使用docker运行MinerU前需确保物理机已安装支持CANN 8.0.RC2的驱动和固件
- 此更新有助于用户更好地准备适配Ascend NPU的环境，避免潜在的运行问题

feat: enable table recognition by default- Set table recognition to enabled by default in the UI

- Change default layout model to 'doclayout_yolo'- Enable table recognition in the magic-pdf template

Dev

- Update Docker run command in both README.md and README_zh-CN.md
- Add command to automatically activate the virtual environment upon container start
- Ensure users have the correct environment setup when accessing the container

- Align python3.10-dev and python3-pip for improved visual consistency
- Enhance Dockerfile formatting without changing functionality

docs(README): update for 1.0.0 release and improve documentation

- Update README.md and README_zh-CN.md for 1.0.0 release
- Add new API and compatibility information
- Update links to user guide and documentation
- Improve NPU acceleration section

fix(table): handle empty OCR result in rapidtable

- Add check for empty OCR result when using PaddleOCR model
- Assign None to ocr_result if no text is detected, preventing further errors

docs(README): add Ascend NPU acceleration guide

- Add new file README_Ascend_NPU_Acceleration_zh_CN.md in docs folder
- Update README.md and README_zh-CN.md to include link to new NPU acceleration guide
- Provide instructions for building and running Docker image for Ascend NPU
- List known issues and limitations when using Ascend NPU

Refactor/remove unused code

feat：Add NPU support

- Update package sources to use Aliyun mirrors for faster downloads
- Upgrade pip and install Python packages in virtual environment
- Add python3.10-dev package to Huawei NPU Dockerfile
- Update requirements file URLs to master branch- Install specific version of torch_npu in Huawei NPU Dockerfile
- Update magic-pdf installation method
- Improve modelscope installation process
- Optimize model download and configuration update steps

- Update Dockerfiles in china, global, and huawei_npu directories
- Improve wget commands by specifying output file names
- Update READMEs to reflect new Dockerfile locations

- Add Dockerfile for global setup with Ubuntu base image
- Add Dockerfile for Huawei NPU setup with Ascend base image
- Update requirements file structure:  - Rename requirements-docker.txt to docker/china/requirements.txt - Add new requirements files for global and Huawei NPU setups
- Install necessary packages and dependencies in both Dockerfiles- Set up virtual environment and install Python packages
- Download models and configure magic-pdf for both setups

- Add section for using NPU acceleration in both English and Chinese README files
- Update system requirements to include CANN environment for NPU support
- Enhance the "Quick Start" guide with NPU-related information- Modify hardware requirements to specify "Ascend 910b" for NPU acceleration

- Add `draw_char_bbox` function to `draw_bbox.py` for drawing character bounding boxes
- Integrate `draw_char_bbox` into `common.py` for use in PDF processing pipeline
- Include option to draw character bounding boxes in debug mode

style(pdf_parse_union_core_v2): remove unnecessary spaces and improve code formatting- Remove extra space in conditional statement for character spacing logic
- Adjust spacing in trigonometric checks for line direction- Improve overall code readability and consistency

- Add missing 'else' statement in OCR model selection logic
- Ensure consistent formatting of 'if' statements for better readability
- Remove unnecessary empty line in the 'app.py' file

- Remove logger.info() call for additional_ocr_params to reduce log verbosity

- Implement ONNXModelSingleton to manage ONNX models
- Modify ModifiedPaddleOCR to use ONNX models on ARM CPUs without CUDA
- Update RapidTableModel to use RapidOCR with ONNXRuntime on CPU
- Add rapidocr_onnxruntime dependency in setup.py

fix(web_api): Modify the import path of InferenceResult

refactor(pdf_parse): improve character spacing handling in PDF text extraction

- Update the logic for inserting spaces between characters- Consider the next character's position instead of the previous one
- Adjust the spacing threshold to 25% of the average character width
- Ignore spaces at the end of lines to prevent double spaces

- Update the logic for inserting spaces between characters- Consider the next character's position instead of the previous one
- Adjust the spacing threshold to 25% of the average character width
- Ignore spaces at the end of lines to prevent double spaces

- Remove use_npu variable initialization
- Comment out device assignment and npu check
- Comment out use_npu parameter in ModifiedPaddleOCR constructor

- Update `clean_memory.py` to use `torch_npu.npu` instead of `torch.npu`
- Update `model_utils.py` to use `torch_npu.npu` instead of `torch.npu`
- Simplify NPU availability check and bfloat16 support in `pdf_parse_union_core_v2.py`

- Remove upper version limit for pydantic dependency
- This change allows for the use of the latest pydantic version

fix: s3 path join method