<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
h1
{mso-style-priority:9;
mso-style-link:"Heading 1 Char";
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:24.0pt;
font-family:"Calibri",sans-serif;
font-weight:bold;}
h4
{mso-style-priority:9;
mso-style-link:"Heading 4 Char";
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Calibri",sans-serif;
font-weight:bold;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.Heading1Char
{mso-style-name:"Heading 1 Char";
mso-style-priority:9;
mso-style-link:"Heading 1";
font-family:"Calibri Light",sans-serif;
color:#2F5496;}
span.Heading4Char
{mso-style-name:"Heading 4 Char";
mso-style-priority:9;
mso-style-link:"Heading 4";
font-family:"Calibri Light",sans-serif;
color:#2F5496;
font-style:italic;}
span.c-gray-7
{mso-style-name:c-gray-7;}
span.th-meta
{mso-style-name:th-meta;}
span.EmailStyle24
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1><div><p>Engadget - Wednesday, January 20, 2021 at 10:48 AM<o:p></o:p></p><h1>Facebook improves AI photo descriptions for the visually impaired<o:p></o:p></h1><h4>Sponsored Links<o:p></o:p></h4><p class=MsoNormal><img width=15 height=15 style='width:.1562in;height:.1562in' id="_x0000_i1031" src="https://s.yimg.com/cv/apiv2/adbuilder/gemini.png"><o:p></o:p></p><p class=MsoNormal><img id="_x0000_i1032" src="https://o.aolcdn.com/images/dims?thumbnail=640%2C&quality=95&image_uri=https%3A%2F%2Fs.yimg.com%2Fos%2Fcreatr-uploaded-images%2F2021-01%2Fb2468a50-5b2f-11eb-9ef1-c70c68f84287&client=amp-blogside-v2&signature=007e2a913cd088d20efe5e3c38db43698f0f3729" alt="Facebook AI photo description for the visually impaired"><span class=c-gray-7>Facebook </span><o:p></o:p></p><p>Facebook has long been <a href="https://www.engadget.com/2017-02-02-facebook-ai-image-search.html">using AI to describe photos</a> for the visually impaired, but it’s stepping up its efforts in 2021. The social media giant has <a href="https://ai.facebook.com/blog/how-facebook-is-using-ai-to-improve-photo-descriptions-for-people-who-are-blind-or-visually-impaired/" target="_blank">detailed</a> a new version of automatic alternative text (AAT) that promises much more information.<o:p></o:p></p><p>Instead of relying on heavily supervised AI learning, Facebook is now using weak supervision based on “billions” of Instagram photos and hashtags. The method lets Facebook expand beyond just 100 concept descriptions to include over 1,200, such as different kinds of food and national monuments. It’s also more culturally inclusive — it can recognize weddings that don’t involve white wedding dresses, for example.<o:p></o:p></p><p>A new object detection system can also recognize where people are in the frame as well as the number of people in the scene. And while you’ll normally get a simple summary of a photo’s contents, you’ll have the choice of a detailed description that outlines the position, size and nature of objects.<o:p></o:p></p><p>This still offers an imperfect description — Facebook stressed that it still uses “may be” and errs on the side of excluding concepts it can’t solidly recognize. It’s a big leap for accessibility on the social network, though, and could ensure that more visually impaired people at least get the gist of photos in their feeds.<o:p></o:p></p><p class=MsoNormal>In this article: <span class=th-meta><a href="https://www.engadget.com/tag/Facebook">Facebook</a>, <a href="https://www.engadget.com/tag/AI">AI</a>, <a href="https://www.engadget.com/tag/artificial%20intelligence">artificial intelligence</a>, <a href="https://www.engadget.com/tag/Machine%20learning">Machine learning</a>, <a href="https://www.engadget.com/tag/Social%20network">Social network</a>, <a href="https://www.engadget.com/tag/social%20networking">social networking</a>, <a href="https://www.engadget.com/tag/Social%20media">Social media</a>, <a href="https://www.engadget.com/tag/internet">internet</a>, <a href="https://www.engadget.com/tag/accessibility">accessibility</a>, <a href="https://www.engadget.com/tag/blind">blind</a>, <a href="https://www.engadget.com/tag/blindness">blindness</a>, <a href="https://www.engadget.com/tag/visually%20impaired">visually impaired</a>, <a href="https://www.engadget.com/tag/gear">gear</a> </span><o:p></o:p></p><p class=MsoNormal><img border=0 id="_x0000_i1033" src="https://s.blogsmithmedia.com/www.engadget.com/assets-h07750ff94825edf98d4aa04ff0d736bf/images/comment.png?h=fdd3d5c323dfc3c958e02b675be27a59" alt=Comment><o:p></o:p></p><p class=MsoNormal><img border=0 id="_x0000_i1034" src="https://s.blogsmithmedia.com/www.engadget.com/assets-h07750ff94825edf98d4aa04ff0d736bf/images/share.png?h=cbc29d9c8df9d466b2c41b69605d5261" alt=Share><o:p></o:p></p><p><a href="https://www.engadget.com/facebook-explains-ai-alt-text-for-photo-descriptions-154018448.html">https://www.engadget.com/facebook-explains-ai-alt-text-for-photo-descriptions-154018448.html</a><o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p></div></div></body></html>