Mobilio: a phone-only navigation aid that helps blind walkers avoid obstacles

Harvard's Mobilio app turned an ordinary smartphone into a guide that cut indoor collisions 41% in a small test with cane users.

Researchers at Harvard have built Mobilio, an AI app that guides blind and low-vision people to a chosen destination and steers them around obstacles and hazards with customizable audio beeps. The work appears in Nature Biomedical Engineering, authored by PhD student Raymond Liu and assistant professor of bioengineering Patrick Slade.

The app combines the phone's camera, GPS and motion sensing, plus LiDAR where the phone has it. A computer-vision model reads live camera video to propose a safe path, and the audio cues are matched to the user's walking gait. Its segmentation datasets use images taken from a pedestrian's viewpoint rather than a driver's, which suits sidewalks and crosswalks. The design started with a survey of more than 100 people with limited or no sight, who named three needs: steady guidance along straight paths, accurate real-time turn-by-turn directions, and dependable obstacle detection.

In testing, 14 subjects used Mobilio with a cane. They reached destinations 13% faster than people using a cane with Google Maps, and had 41% fewer indoor collisions. Liu called it a key breakthrough that this runs on a standard phone instead of costly specialty hardware with faster processors and more memory.

That last point is what matters for abundance. Mobility aids for blind people have often depended on dedicated devices that are expensive and hard to reach. Software on a phone many people already carry could make safer, more independent travel far more widely available, with knock-on benefits for care burdens and social participation.

The caveats are real. The sample was only 14 people, the collision figure applies to indoor settings, and the comparison baseline, Google Maps, is described as not detailed enough for safe use by visually impaired people. The team plans more real-world testing of how Mobilio fits daily routines, habits and preferences. Whether and when it reaches the public is not stated in the material we have.

Source: New Atlas