1. 26 Dec, 2024 1 commit
    • myhloli's avatar
      feat(model): add npu support and optimize table model · 7990e7df
      myhloli authored
      - Add NPU support for memory cleaning and model initialization
      - Optimize table model initialization and prediction process
      - Update memory utils to support NPU
      - Add language parameter for table model
      7990e7df
  2. 03 Dec, 2024 2 commits
    • myhloli's avatar
      fix(vram): improve VRAM checking logic · 104273cc
      myhloli authored
      - Update VRAM checking logic in app.py and model_utils.py
      - Add None and type checks for VRAM values
      - Adjust concurrency limit calculation in app.py
      - Modify clean_vram function to handle cases with no VRAM information
      104273cc
    • myhloli's avatar
      feat(gradio_app): implement dynamic concurrency limit based on VRAM · b1fe9d4f
      myhloli authored
      - Add get_concurrency_limit function to calculate concurrency limit based on VRAM
      - Update clean_vram function and rename to get_vram for better clarity
      - Apply concurrency limit to the to_markdown function in the Gradio app
      b1fe9d4f
  3. 15 Nov, 2024 1 commit