Seeing AI is a free app that narrates the world around you. Designed with and for the blind and low vision community, this ongoing research project harnesses the power of AI to open up the visual world by describing nearby people, text and objects.
Seeing AI provides tools to assist with a variety of daily tasks:
• Short Text - Speaks text as soon as it appears in front of the camera.
• Documents - Provides audio guidance to capture a printed page, and recognizes the text, along with its original formatting.
• Products - Scans barcodes, using audio beeps to guide you; hear the name, and package information when available.
• People - Saves people’s faces so you can recognize them, and get an estimate of their age, gender, and expression.
• Currency - Recognizes currency notes.
• Scenes - Hear an overall description of the scene captured. Explore the photo by moving your finger over the screen to hear the location of different objects.
• World - An Audio Augmented Reality experience to explore an unfamiliar environment, including hearing objects announced around you with Spatial Audio (requires a device with a LiDAR, and iOS 14+).
• Indoor Navigation - Available on the World Channel, enables you to create routes through a building, like "entrance to classroom", and navigate by following the sound (requires a device with an A9 or later processor, and iOS 14+).
• Colors - Identifies colors.
• Handwriting - Reads handwritten text like in greeting cards (available in a subset of languages).
• Light - Generates an audible tone corresponding to the brightness in the surroundings.
• Images in other apps - Just tap “Share” and “Recognize with Seeing AI” to describe images from Mail, Photos, Twitter, and more.
• Browse Photos - Hear descriptions of photos saved on your device.
Seeing AI continues to evolve as we hear from the community, and AI research advances.
Check out tutorials with this YouTube playlist: http://aka.ms/SeeingAIPlaylist.
Questions, feedback or feature requests? Email us at SeeingAI@Microsoft.com.
• Rich Image Descriptions: Seeing AI can now provide far more detail in image descriptions. Take a photo on the Scene channel, select an image in Browse Photos, or share a photo from another app - and then tap "More Info".
• Ask Questions About Documents: On the Document channel, after scanning a page, you can now ask Seeing AI questions about its contents. This can be much more efficient than listening to the document from beginning-to-end. For example, you could scan a menu, and ask for just the vegetarian options; scan a receipt, and find out how much a particular item cost; or scan a calendar, and ask when a particular event is.
• Multi-page document scanning: On the Document channel, you can now scan multiple pages into a single document for reading, or sharing.
• For easier access to image descriptions, the Scene channel has been moved to earlier in the channel switcher. You can customize the order of channels in Settings.
• Plus, various bug fixes under the hood.
• Please remember to use your judgement when reading AI generated content. We appreciate your feedback as the technology continues to evolve.
Ratings and Reviews
Should be quite...
... useful for those of us with limited sight. Did some basic testing, and it’s not perfect, but what is? 😉
Wasn’t great with the colours, but I suspect that’s because the light was too bright from the phone, and it was bouncing-off reflections of that light, making darker colours appear brighter, or altering the colour detected completely.
For those of us with NO colour vision, this would likely cause issues, but I usually get family to help me when needed 👍.
The product ID worked on the 3 products I tested, it was flawless 😀.
The text/document test was ok, but as usual for these talking apps, I had to slow it down to make it more legible.
Overall, a very useful app, but needs work in some areas 😊👍.
Developer Response ,
Thank you for the ★★★★ rating... We are very pleased that you are enjoying Microsoft Seeing AI app. Version (2.3) has improved features with a few experimental Channels for Scenes, Colors, and Handwriting --- Please visit www.SeeingAI.com for more information, updates, and tutorials.
Incredibly handy app for the visually impaired!
I won’t write much here, because for those of you who are interested and who are looking for this app, they will know exactly what it does and what it is, however I just want to say a big thank you to Microsoft for finally releasing this incredibly useful app here in the UK. I have been using the version of the app available in the US for some time now, and would find it impossible to live without it! Many of the features such as product recognition, short text and document functions are vital for my everyday practice IT and independence and I look forward to future updates/additional features as they become available. Thank you again for a great app.
I am sight impaired and this app helps me to read all text papers or any text. Before I use to take picture of any text and zoom to read even at train stations it took me three times of time to travel to my destinations. Some times I pretended like is my first time to ask anyone, and many times I was asked why i am not wearing glasses. How to explain them that the cause i am partly blind is because radio therapy, no glasses can help me. This app it helps me anywhere.
Data Not Linked to You
The following data may be collected but it is not linked to your identity:
- Usage Data
Privacy practices may vary based on, for example, the features you use or your age. Learn More
- Microsoft Corporation
- 322.5 MB
- Requires iOS 12.0 or later.
- Requires iPadOS 12.0 or later.
- iPod touch
- Requires iOS 12.0 or later.
English, Czech, Danish, Dutch, Finnish, French, German, Greek, Hungarian, Italian, Japanese, Korean, Norwegian Bokmål, Polish, Portuguese, Russian, Spanish, Swedish, Turkish
- Age Rating
- © 2023 Microsoft Corporation. All rights reserved.