GitLab

docs(README): update changelog for v0.9.1 release- Add entry for 0.9.1 release on 2024/11/06- Update changelog in both English (README.md) and Chinese (README_zh-CN.md)
- Include integration of StructTable-InternVL2-1B model for table recognition

- Replace the incorrect arXiv paper link with the correct one in both README.md and README_zh-CN.md
- Update the badge image link from 'pdf' to 'abs' for the correct paper URL

- Add lxml dependency for HTML parsing
- Update test case to use XPath and HTML parser for structure and content validation
- Check for presence of essential HTML elements like <table>, <thead>, <tbody>, <tr>, and <td>
- Validate column headers and specific row contents

- Remove outdated version options (0.6.x, 0.7.x, 0.8.x)- Add current version option (0.9.x)

- Add information about AVX/AVX2 instruction set issues on Linux servers
- Provide guidance for users encountering "Illegal instruction (core dumped)" error
- Suggest contacting system administrator or changing servers as potential solutions
- Include relevant issue references for context

- Replace np.array with np.asarray for better performance
- Add image color conversion from RGB to BGR using OpenCV

- Update the Colab demo link in the README files to the new version
- Add a note in the Japanese README indicating that the document is outdated

chore: add CSS and SCSS files to linguist-vendored- Update .gitattributes to mark CSS and SCSS files as vendored- Ensure these files are not included in language statistics

- Implement __replace_ligatures function to split ligature characters- Integrate ligature replacement into the merge_para_with_text function
- Handle common ligatures such as fi, fl, ff, ffi, and ffl

- Set .js and .mjs files as vendored
- Set .html files as documentation

feat(model): add HTML minification to StructTableModel

- Import 're' module for regular expression operations
- Implement HTML minification for 'output_format=html'
- Add 'minify_html' method to remove unnecessary whitespace and format HTML

feat(table): upgrade StructEqTable model and integrate into PDF Extract Kit

- Comment out an unused code block in the ppTableModel.py file
- Improve code readability and maintainability by removing unnecessary code

- Update StructTableModel to use the latest struct-eqtable library
- Add support for HTML table extraction in PDF Extract Kit
- Improve error handling and model initialization
- Update dependencies in setup.py for struct-eqtable

fix(dict2md): improve text concatenation logic

- Optimize content stripping and checking logic
- Add special case handling for single-character content
- Adjust spacing rules for different content types

feat(para_split_v3): improve list identification with block aspect ratio

- Add block_height calculation to determine block aspect ratio
- Update list identification condition to include aspect ratio check
- Improve code readability with better formatting and line breaks

docs(tutorial): update magic-pdf command with output directory

- Add '-o ./output' flag to magic-pdf command in multiple documentation files

feat(list): improve list detection algorithm & fix(list): improve list identification accuracy

feat(list): improve list detection algorithm- Add center_close_num and external_sides_not_close_num variables to analyze line positioning
- Implement new list detection condition for centered lines
- Enhance existing list detection logic with additional checks

fix(list): improve list identification accuracy- Adjust the threshold for determining right-side spacing to 0.26 * block_weight
- Add TODO comment for special list identification with all centered lines- Modify the condition for recognizing short item lists with left alignment
- Update the condition for identifying the end of a list item

fix(ocr_mkcontent): improve content handling for different languages and equation types

- Include InlineEquation in the condition for handling text content
- Remove separate block for InlineEquation processing
- Ensures consistent handling of inline equations and text, improving content formatting

fix(ocr_mkcontent): improve content handling for different languages and equation types- Adjust content formatting for Chinese, Japanese, Korean, and Western languages
- Implement proper spacing rules around inline equations- Remove unnecessary empty lines in paragraph text

Feat/tune docs

feat(pdf_parse): improve span filtering and add new block types

- Refactor remove_outside_spans function to filter spans more accurately
- Add image_footnote, index, and list block types to output file documentation
- Update draw_span_bbox to use preproc_blocks instead of para_blocks
- Bump version to 0.9.0

fix(pdf_parse): improve span removal logic for all content types 

- Update remove_outside_spans function to handle all content types
- Add processing for text and equation spans
- Improve overlap calculation for better accuracy

- Update remove_outside_spans function to handle all content types
- Add processing for text and equation spans
- Improve overlap calculation for better accuracy

- Update remove_outside_spans function to handle all content types
- Add processing for text and equation spans
- Improve overlap calculation for better accuracy