"git@developer.sourcefind.cn:OpenDAS/fastmoe.git" did not exist on "2bcf98d70610bdff1d6f39f752949f6a0f8c5b89"
Unverified Commit 8cbb7ba1 authored by Yuliang Liu's avatar Yuliang Liu Committed by GitHub
Browse files

Update README.md

parent b63ace06
...@@ -24,11 +24,15 @@ ...@@ -24,11 +24,15 @@
# TODO # TODO
- [x] Open source code, weight, and data - [x] Open source code, weight, and data
- [ ] Support training using 3090 GPUs (24Gb video memory)
- [ ] Improve Chinese language proficiency - [ ] Improve Chinese language proficiency
- [ ] TextMonkey with different LLMs - [ ] TextMonkey with different LLMs
# Model Zoo # Model Zoo
TextMonkey was trained using 8 A800 GPUs on a dataset of just 40k image-text pairs, requiring approximately 1 day and 6 hours of training time. It is capable of running inference on a 3090 GPU.
| Method | LLM | STVQA | TextVQA | OCRVQA | DocVQA | InfoVQA | ChartQA | FUNSD | SROIE | POIE | OCRBench | | Method | LLM | STVQA | TextVQA | OCRVQA | DocVQA | InfoVQA | ChartQA | FUNSD | SROIE | POIE | OCRBench |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| BLIP2-OPT-6.7B | OPT-6.7B | 20.9 | 23.5 | 9.7 | 3.2 | 11.3 | 3.4 | 0.2 | 0.1 | 0.3 | 235 | | BLIP2-OPT-6.7B | OPT-6.7B | 20.9 | 23.5 | 9.7 | 3.2 | 11.3 | 3.4 | 0.2 | 0.1 | 0.3 | 235 |
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment