GitLab

add support for more document types

Fix/parallel split

perf(inference): optimize batch processing for different GPU memory s…

- Set NPUDTCompile to false for better performance on NPU
- Adjust batch ratio

fix(pre_proc): add Discarded block type to span block type compatibility

- Include BlockType.Discarded in the list of compatible block types for ContentType.Text and ContentType.InlineEquation
- This change improves the OCR dictionary merging process by handling discarded blocks more effectively

master->dev

Release 1.2.2

refactor(magic_pdf): improve paragraph splitting logic and update dep…

- Optimize paragraph splitting algorithm for better text block separation
- Update fast-langdetect dependency to ensure compatibility

master -> dev

Release 1.2.1

docs(readme): update changelog for v1.2.1 release

fix(readme): update changelog for v1.2.1 release

- Update README.md and README_zh-CN.md with the latest changes
- Add details about bug fixes in version1.2.1
- Include improvements for full-width to half-width conversion, caption matching, and formula span issues

perf(inference): adjust batch ratio for high GPU memory

- Increase batch ratio to 8 for GPU memory >=16GB
- Improve inference performance on systems with higher GPU memory

fix: caption match

refactor(pre_proc): allow interline equations to be associated with text blocks

- Update OCR dictionary merge logic to include text blocks when processing interline equations
- This change improves the handling of equations that may be embedded within text content

perf(mfr): improve Math Formula Recognition by sorting images by area

- Simplify batch ratio logic for GPU memory >= 16GB
- Remove unnecessary conditions for 20GB and 40GB memory

- Simplify batch ratio logic for GPU memory >= 16GB
- Remove unnecessary conditions for 20GB and 40GB memory

- Sort detected images by area before processing to enhance MFR accuracy
- Implement stable sorting to maintain original order of images with equal

- Comment out @measure_time decorator for txt_spans_extract_v2 and sort_lines_by_model functions
- Remove logger.info for page_process_time
- Comment out PerformanceStats.print_stats call

- Add performance_stats module to measure and print execution time statistics
- Implement measure_time decorator to track execution time of key functions
- Remove multi-threading in pdf parsing for better resource management
- Optimize pdf parsing logic for improved performance