This screencapture from Apple’s latest demo depicts the ecosystem’s new real-time environmental descriptions and on-demand subtitles.
Credit: Apple
This Tuesday, Apple announced new, Apple Intelligence-powered accessibility options for iOS, iPadOS, macOS, tvOS, and visionOS. These largely center on‑device processing for people who are blind, have low vision, are deaf or hard of hearing, or have motor and cognitive disabilities.
Firstly, VoiceOver and Magnifier are set to use Apple Intelligence to provide descriptions of images, documents, and surroundings, including context such as layout, text, and objects in view. Users can point the camera at what is in front of them and ask questions, and the system responds with spoken descriptions.
Apple is also bringing Apple Intelligence to Voice Control, making it possible to use natural language to “tap” onscreen buttons or controls by describing them. (Example: “Tap the purple folder.”) Accessibility Reader is set to generate AI‑powered summaries and translations for content like research papers or news stories.
iPhone, iPad, Mac, Apple TV, and Vision Pro users will see local subtitles for videos that don’t already have them, starting with English in the US and Canada. Apple says audio stays on the device and subtitles work for personal clips, shared videos, and some streaming content.
And finally, for motor accessibility, Apple Vision Pro will let some users control compatible power wheelchair systems with eye tracking, in partnership with companies like Tolt and LUCI in the US.
Other updates include larger text on tvOS, better hearing aid support across devices, expanded Name Recognition in more than 50 languages, and support for Sony’s Access controller on Apple platforms.
