Real TIme Image Processing (OCR) [closed]

Question

I am planing to develop an app like Word Lens. Can any one suggest a good library that I can use? or any one explain technology behind the Word Lens App? is it reel time image matching or OCR? I know some image processing library like OpenCv, tesseract...Any help is greatly appreciated...

Answer 1

I'm one of the creators of Word Lens. Although there are some OCR libraries out there (like tesseract), we decided to make our own in order to get better results and performance. Our general algorithm goes like this:

1. copy the image from the camera and get its grayscale component
2. level out the image so the text stands out clearly against the background
3. draw boxes around things that look like characters & sentences
4. do OCR: match the pixels in each box against a database of characters -- this is actually pretty hard!
5. collect the characters into words, look up in a dictionary (this is hard too, because there will be mistakes in the OCR)
6. draw the results back onto the image

Image matching by itself is not good enough, because of the huge variety of fonts, words, and languages out there.

OpenCV is a great library to get up and running with, and to learn more about computer vision in general. I would recommend building off their examples, and playing around there. Have fun!