Categories: News

Google Research Project Wants To Auto-Caption Your Selfies

Selfie is a virus from which everyone is affected and it has developed several forms as it spread around the world. Imagine if your selfie turns up at a Google Search Engine and it adds an auto-caption with the image through its advanced algorithm. “A person with an awkward mouth formation…..” Okay, it might not be that accurate.

Google has developed a system which can teach itself how to describe a photograph with a very high degree of accuracy. In other words, Google is trying to create a full natural language description of the image as it was mentioned in the recent Google research paper published at its site. Check out the image below to get the idea.

 

Usually, a typical approach to the problem is to first let the computer vision algorithm scan the image and then use natural language processing to create a description for it. However, Google is taking an entirely different but better approach. They want to merge the recent computer vision and language models into a single jointly trained system which will take an image and produce a human readable sequence of words to describe it. According to Google, the later approach has worked well in machine translation systems but the captioning system works differently using the same approach and it is not perfect.

Bilingual Evaluation Understudy (BLEU) score is generally used to compare the quality of machine translated description with that of a normal human description. It gave computer captioning system a score between 27 and 59 points depending on the dataset whereas a typical score for humans is around 69. It is still a huge step forward but, in near future, it might save you from writing those deeply thought statements with your selfies.

Sponsored
Sarwat Fatima

Sarwat is a journalist and DIY enthusiast. She loves writing about Startups and Businesses. She is heading Islamabad and surrounding areas for news coverage.

Leave a Comment
Share
Published by
Sarwat Fatima

Recent Posts

WhatsApp Beta Partners with Google for Innovative Image Search Feature

When it comes to Android messaging apps, WhatsApp stands out as one of the best.…

25 mins ago

Farrukh Sabzwari Appointed as CEO of PSX, Set to Serve for Three Years

Farrukh H. Sabzwari has been appointed Chief Executive Officer (CEO) of Pakistan Stock Exchange Company…

1 hour ago

250 Government Schools to Be Run by Private Sector

RAWALPINDI: The chairman of the Punjab Education Foundation, Malik Shoaib Awan, stated on Monday that…

2 hours ago

Pakistan Launches First National Sex Offenders Register to Combat Sexual Violence

Pakistan has taken a significant step towards addressing sexual violence and abuse with the introduction…

2 hours ago

SBP Chief Reports October Remittances Exceed $3 Billion

KARACHI: The State Bank of Pakistan (SBP) is anticipating $500 million from the Asian Development…

3 hours ago

Sindh Assembly Reveals 28,500 Govt Employees’ Spouses as Illegal BISP Beneficiaries

The Sindh Assembly was informed that over 28,500 employees of the provincial government were unlawfully…

4 hours ago