News

Facebook now lets you search for photos by describing their contents

Facebook AI now lets you search a photo by describing the contents of the image or using keywords.

This is different than searching the photos in which you are tagged or pictures that are labeled i.e text-word searching. Many times users forget to label a photo or add a description and it becomes difficult for them to search later. With Facebook’s new AI search, users just have to describe the contents of the photo e.g, “black shirt”, “water park” or “walking to..” etc., and Facebook will identify the pictures through visual search.

“We’ve pushed computer vision to the next stage with the goal of understanding images at the pixel level. This helps our systems do things like recognize what’s in an image, what type of scene it is, if it’s a well-known landmark, and so on. This, in turn, helps us better describe photos for the visually impaired and provide better search results for posts with images and videos.

More than 200 visual models have been trained and deployed on Lumos by dozens of teams, for purposes such as objectionable-content detection, spam fighting, and automatic image captioning. The applications are wide-reaching, with everyone from our Connectivity Labs to Search to the Accessibility team using the technology.”

Lumos is Facebook’s platform that is built for image and video understanding. When photos are uploaded, this platform not only stores them on Facebook but also memorize their contents with deep machine learning and image understanding technology e.g, where the photo was taken, what are people doing in that, what colors etc. This is mainly helpful for visually impaired people.

“Until recently, these captions described only the objects in the photo. Today we’re announcing that we’ve added a set of 12 actions, so image descriptions will now include things like “people walking,” “people dancing,” “people riding horses,” “people playing instruments,” and more.”

Facebook says that it is just the beginning of the visual search and it may also bring this feature for video contents in future.

Sponsored
Maheen Kanwal

Maheen Kanwal is a Tech Journalist at TechJuice. She covers the latest technological, telecom and business related, local & global news. (Reach at maheen@techjuice.pk)

Leave a Comment
Share
Published by
Maheen Kanwal

Recent Posts

Indian Army Granted Authority to Directly Takedown Social Media Content

The Indian Army has been granted direct authority to manage social media content concerning its…

8 hours ago

NUST Achieves Global Recognition with 43 Researchers Among World’s Top 2% Scientists

In an extraordinary accomplishment for Pakistani academia, 43 researchers from the National University of Sciences…

9 hours ago

Khyber Pakhtunkhwa Govt Ready to Acquire PIA with Bid Exceeding Rs10bn

The Khyber Pakhtunkhwa (KP) government has officially informed the federal government of its intention to…

10 hours ago

PTA Cautions Public on Illegal and Unlicensed Forex Trading Platforms

The Pakistan Telecommunication Authority (PTA) has issued a stern advisory, warning citizens against investing in…

10 hours ago

Record Emigration: Economic Instability Forces Pakistan’s Best and Brightest to Depart

Economic challenges are prompting skilled workers to leave Pakistan, resulting in a significant talent drain…

13 hours ago

Russia’s Fine on Google Exceeds World’s Economy

A Russian court has fined Google for blocking state-run media channels on YouTube, imposing a…

1 day ago