Multilingual-Reader

in this repository we will share our works related to multilingual document reading (english,bangla and arabic).this is a work in progress,we will gradually update the repo inshaa allah

Environment Setup

DEV LOCAL ENVIRONMENT

OS : Ubuntu20.04.3LTSMemory : 23.4GiBProcessor : Intel® Core™ i5-8250UCPU @ 1.60GHz × 8Graphics : Intel® UHDGraphics620 (KabylakeGT2) Gnome : 3.36.8

python requirements

• dev - cpu - test -install

stable test environment

• Manual Setup

condacreate-nmlreaderpython=3.8-ycondaactivatemlreadercondainstall-nmlreaderipykernel--update-deps--force-reinstall-y
./install.sh

Stack

• Line based detector model: paddleOCR en-dbnet
• Word based detector model: paddleOCR ml-dbnet
• English recognizer: paddleocr - en -SVTR_LCnet
• Arabic recognizer: paddleocr - ar
• Bangla recognizer: easyocr - bn
• Word classifier : Custom
  • Kaggle Dataset Link
  • onnx conversion kernel
  • training kernel

Change-log (Dev branch)

02-06-22

• merging solved
• lang model auto download
• classifier addition
• solved negative stride issue

Docs

• docs/dev.md: dev branch doc
• weights/weights.md: custom weights integration doc

Demo

• see : demo.ipynb