GitLab

Release 1.2.2

refactor(magic_pdf): improve paragraph splitting logic and update dep…

- Optimize paragraph splitting algorithm for better text block separation
- Update fast-langdetect dependency to ensure compatibility

master -> dev

Release 1.2.1

docs(readme): update changelog for v1.2.1 release

fix(readme): update changelog for v1.2.1 release

- Update README.md and README_zh-CN.md with the latest changes
- Add details about bug fixes in version1.2.1
- Include improvements for full-width to half-width conversion, caption matching, and formula span issues

perf(inference): adjust batch ratio for high GPU memory

- Increase batch ratio to 8 for GPU memory >=16GB
- Improve inference performance on systems with higher GPU memory

fix: caption match

refactor(pre_proc): allow interline equations to be associated with text blocks

- Update OCR dictionary merge logic to include text blocks when processing interline equations
- This change improves the handling of equations that may be embedded within text content

perf(mfr): improve Math Formula Recognition by sorting images by area

- Simplify batch ratio logic for GPU memory >= 16GB
- Remove unnecessary conditions for 20GB and 40GB memory

- Simplify batch ratio logic for GPU memory >= 16GB
- Remove unnecessary conditions for 20GB and 40GB memory

- Sort detected images by area before processing to enhance MFR accuracy
- Implement stable sorting to maintain original order of images with equal

- Comment out @measure_time decorator for txt_spans_extract_v2 and sort_lines_by_model functions
- Remove logger.info for page_process_time
- Comment out PerformanceStats.print_stats call

- Add performance_stats module to measure and print execution time statistics
- Implement measure_time decorator to track execution time of key functions
- Remove multi-threading in pdf parsing for better resource management
- Optimize pdf parsing logic for improved performance

- Add ThreadPoolExecutor to process PDF pages in parallel
- Create separate function for page processing to improve readability and maintainability
- Include error handling for individual page processing tasks
- Log total page processing time for performance monitoring

refactor(ocr_mkcontent): optimize full-width character handling

- Update condition to only convert full-width letters and numbers
- Remove separate case for full-width space

Release 1.2.0

fix: match multiple captions

Release 1.2.0

refactor(magic_pdf): remove bfloat16 support checks and usage

refactor(magic_pdf): remove bfloat16 support checks and usage

- Replace complex device selection logic with a single line using torch.device
- Remove redundant checks and imports for better readability and maintainability

- Remove supports_bfloat16 variable and related checks
- Remove model.bfloat16() call for LayoutLMv3ForTokenClassification
- Simplify device selection logic

Release 1.2.0