Visual Search Technology App Facilitates Translation

I have blogged a few times about visual search technology, augmented reality, and how apps like Google Goggles allow you to use your smart phone to get information about objects just by holding the camera up to it. An app called Word Lens was recently released that shows the capability of this technology for nearly instantaneous translation of text. There's a lot of buzz about the app because it is a very promising step in the useful application of this technology. You can read more about the app on iTunes here.

 

Check out the accompanying demonstration video that shows how Word Lens works. If the embedded video isn't loading, you can access it here.


Granted, it’s not perfect. First of all, it only translates English to Spanish or Spanish to English. If there is a lot of text to translate, it may not get it all the words, or may translate only parts of a word. And it doesn’t always translate context very well -- a literal translation of each word may not communicate the message clearly. Of course, stylized writing or hand writing may not be recognized -- clearly printed fonts are the easiest to translate. But regardless, this app is a very cool step forward in visual search technology apps.

 

Want more info? There's a nice review of the app here and a follow up that has additional criticisms here. But the potential of this technology is huge, and think of the possibilities if they could do it with character based languages like Japanese or Chinese. What do you think? Have you used Word Lens and has it worked well for you? Why or why not? 

 


Comments

Blog posts and comments do not necessarily reflect the opinions, official position, or policies of the American College of Chest Physicians or The CHEST Foundation.

ACCP reserves the right to modify or delete inappropriate comments according to chestnet.org Terms of Use agreement.

Engaging article - actually

Engaging article - actually came to the site for something completely different, but glad I stumbled upon this. Any plans for future updates on the subject? Steven

Hard to demo

I wanted to try it when I first heard about it from friends on Facebook, but there is no good way to sample it. You can download the app for free from iTunes, but then all the language modules cost extra...and this is not made very clear at the outset. So, alas, no demo yet. I would have liked to see some sample included with the app, then in-app purchase for more modules. Maybe a lesser known language could be provided, like Urdu or Welsh. Definitely cool technology, but I have to try it first.

I agree

Lorena, I agree completely. I splurged for the app and so far it works ok, but not perfectly. It definitely does not read scripted or stylized fonts, and you have to hold it real still to get it to translate clearly. And the modules are separate, meaning that Spanish to English costs $9.99 and English to Spanish costs $9.99. I actually know Spanish pretty well and don't necessarily need the app. I think it's really cool technology, and agree it will be more useful when there are more language options to choose from. Again, character based languages like Japanese, Chinese, Korean, Thai, etc would be great.