CS 491 - Virtual and Augmented Reality - Week 2

Thoughts about google translate

In today's world, where there are multiple cultures coexisting with each other, the biggest challenge for the technology and scientists is how to bring everyone close each other. When televisions were invented, people were excited that they get to know about different countries and their colorful cultures in their full glory. Even to this day, travel and living programs are one of the most exciting thing on the television. These programs inspired many people to travel to exotic locations and experience everything in person.

Dreaming of traveling to exotic location aren't you? Source

Now imagine, you are in France sipping an espresso in a bistro. There's music in the background and right from where you are sitting, you can see the Eiffel Tower.You are full of energy and you think you can take over the world. You are living the dream aren't you?

After your breakfast, you do the thing every tourist does. You go to visit Louvre Museum. Its the world's largest art museum and is one of the landmarks of the city. You would have never missed it. You go there and you admire the art created by the one of the best artists of their times. Inspired from the art, you want to get the feel of the local culture. You want to meet the people and learn about their lives and get to know what it feels to be a French citizen. Suddenly, the reality hits you. You realise you do not understand French. You cannot understand their language and probably most of them won't understand your language. It was all easy in the TV, there were voice-overs in your language for each and every person. You don't have that kind of help

Yes something like this!!! Source

Google translate to the rescue!!!

Probably someone at google must have thought "Wouldn't it be cool to create an application that can instantly translate any language to other language?" So, they started small with two languages and now the application supports more than 103 languages in span of 12 years. The app is available both on web and mobile phone application and boasts the following features:

Text translation

Simply provide the text you want to be translated and the application will give its translation

Image translation

In this feature, you need to provide an image to the application. The image detects the text, translates it and show you the result. It also gets better with time as it asks user to check if it has selected the text correctly. The system uses this feedback to make itself better. With continuous use, the application has become so good that it has started supporting real time translations. Now the video feed of the camera is replaced by the translated text. This opens up the opportunities for many use cases. For example, if you want to read a book in another language, you only need to point your camera at the book and you get its instant translation right on your screen. In the image below, the left side is original text and on the right side the screenshot of translated text on the same page.

Apart from that if you are a tourist in a foreign country and you want to know the public signs, you can simply point your camera to the sign and you will be given the exact translation of what the sign says. So, consider the scenario that a French Gentleman has to go to restroom in United States. He doesn't know the language and sure doesn't want to go to ladies restroom, the application comes to his rescue. This can be evidenced in the image below. Also, notice how the app can figure out the font used and give the result in the same font.

Also, if you want to read the texts where there is a mixture of multiple languages. The application is able to pick up the given language from the image and only replaces the text of the language to be translated. For instance, the image given below showcases a pamphlet which contains text in English and Chinese. The application picks up the Chinese text and translates it and then replaces the text with its English translation.

It can also be noted that in some cases the translation is not that perfect. But it gives a very good idea what the text in the image might be pointing towards.

Audio related features

In case a person wants to talk to other person who doesnt know your language. The application provides conversation option where two people can take turns speaking and the application will provide you the translation. Then, other person talks and the translation is provided.

Drawback

As noted above the application is not completely perfect. Sometimes, it doesnot detects the text properly. Sometimes, the translations dont make any sense at all. Also, it's voice recognition algorithm isnt perfect either. Even after 12 years of launch of this application, the application can not be relied for corporate communication where each and every line has legal implications.

Conclusion

In conclusion, the application is very useful and covers alot of real life scenarios. There are some concerns related to the quality of translations. But, for a casual user the application is very useful for day to day life. This application can be used by people to interact with each other or travellers to communicate. Above all, this application gives us a chance to come closer and learn about each other on a more personal level which in my opinion is the best of use of any technology created.