Apple’s Vision Pro Can Soon Help Control Power Wheelchairs With Eye Tracking

Apple is giving its accessibility tools a serious upgrade later this year, and one of the biggest announcements is genuinely meaningful: Vision Pro users will soon be able to control compatible power wheelchairs using their eyes.

The preview was shared ahead of Global Accessibility Awareness Day on May 21, with Apple highlighting a batch of new features powered by Apple Intelligence. The broad idea is simple — make iPhone, iPad, Mac, Apple TV and Vision Pro easier to use for people who rely on assistive tech every day, without throwing privacy out the window.

For Malaysians and SEA users, this matters more than it may look at first glance. Accessibility often feels like an “extra” feature in tech, especially in markets where premium devices are already expensive. But when these tools work well, they can directly affect independence — whether that’s reading documents, navigating apps, watching family videos, or moving around with less help.

VoiceOver is getting smarter image descriptions

Apple’s VoiceOver Image Explorer will use Apple Intelligence to describe images in more detail across the system. That means it should be better at explaining what is inside photos, scanned bills, records and other visual content — especially when proper alt text is missing.

Live Recognition is also being expanded. On supported iPhones, users can press the Action button, ask what the camera is seeing, and then ask follow-up questions. That could be useful in very normal daily situations: checking a receipt, identifying items on a table, or understanding what is in front of you without needing another person to describe it.

Magnifier and Voice Control become more natural

Magnifier is also getting Apple Intelligence features, bringing visual descriptions into its high-contrast interface for users with low vision. Users can use the Action button to ask questions, and also control the app by speaking naturally — for example, asking it to zoom in or switch on the flashlight.

Voice Control is getting a particularly practical upgrade too. Instead of memorising exact button names, labels or number overlays, users will be able to describe what they want in normal language. So if an app has a visual layout, a user could say something like “tap the purple folder” or “open the restaurant guide.”

That sounds small, but it is a big deal when apps are not properly labelled for accessibility — something SEA users will definitely recognise, especially across banking, food delivery, shopping and local government apps where accessibility quality can be uneven.

Reader, translation and captions also improve

Apple’s Accessibility Reader will handle more complex material, including articles with multiple columns, images, tables and scientific-style formatting. It can also create summaries so users can quickly understand the main point before reading deeper.

Translation is being added as well, while keeping custom fonts, colours and formatting. For Malaysia, where people move between English, Malay, Chinese and Tamil content all the time, that kind of built-in support could be genuinely useful if it works smoothly.

Apple is also expanding generated subtitles. Instead of relying only on platforms like YouTube or Facebook, devices will be able to create captions for personal videos and shared media. These captions are generated on-device for privacy and will appear automatically for uncaptioned videos across iPhone, iPad, Mac, Apple TV and Vision Pro.

Vision Pro wheelchair control is the headline feature

The most futuristic update is the new Vision Pro power wheelchair control feature. It uses the headset’s eye-tracking system as an input method for compatible alternative drive systems. Apple says it is designed to work without constant recalibration and across different lighting conditions.

Compatibility includes TOLT and LUCI alternative drive systems, with support through Bluetooth and wired accessories.

This is not just a “cool tech demo” kind of feature. For users with limited mobility, especially people with conditions such as ALS, independent wheelchair control can be life-changing. Apple highlighted Pat Dolan, a GeoALS founder who has lived with ALS for 10 years, describing independent wheelchair control as something deeply valuable.

Of course, the big SEA question is access. Vision Pro is still an ultra-premium product, and compatible wheelchair systems may not be widely available or affordable in Malaysia yet. But the direction is important: if eye-tracking control becomes more common, cheaper and better supported, this could eventually influence assistive mobility tech beyond Apple’s own ecosystem.

For now, Apple’s announcement is a strong reminder that AI in consumer devices does not have to be just about chatbots, photo tricks or productivity flexes. Used properly, it can remove real barriers — and that is the kind of tech progress worth paying attention to.

Source: Engadget