PathPal: Offline Edge-AI for Inclusive Mobility and Literacy Assistance

PathPal is an AI-powered assistive technology designed to address two critical challenges faced by visually impaired individuals: safe mobility and independent access to written information. In many environments, especially in countries like India, navigating public spaces can be extremely difficult due to uneven roads, crowded markets, poor lighting, informal signage, and inconsistent infrastructure. While smartphones and assistive applications have improved digital accessibility, they often fall short in real-world mobility scenarios where users need instant feedback and reliable performance without relying on internet connectivity.

PathPal addresses these limitations through an integrated hardware solution powered by offline edge artificial intelligence. Instead of relying on cloud-based processing, the system performs most of its AI computations directly on the device. This design enables low-latency responses, improved privacy, and consistent performance even in low-connectivity environments such as rural or semi-urban areas.

The device combines cameras and proximity sensors with embedded AI models to monitor the user’s surroundings continuously. As the user moves through an environment, PathPal detects obstacles such as stairs, pits, hanging objects, uneven surfaces, or barriers in the path. When a potential hazard is detected, the device alerts the user through distinct vibration patterns that indicate the direction and severity of the obstacle. Audio alerts can also provide additional contextual information when necessary. This multimodal feedback system allows users to react quickly while minimizing cognitive overload.

Beyond mobility support, PathPal also includes features that assist with reading and information access. Users can point the device toward printed or handwritten materials such as classroom notes, public notices, labels, or forms. Using optical character recognition and speech technologies, the system converts the captured text into spoken output in the user’s preferred language. This capability is especially valuable in educational environments where printed and handwritten materials are still widely used.

Another useful feature of PathPal is currency recognition. The device can identify different denominations of Indian currency notes, allowing visually impaired users to perform financial transactions more confidently without relying on assistance from others. By enabling independent handling of money, the solution improves both autonomy and financial security.

The development of PathPal followed a user-centered design approach involving iterative testing with visually impaired individuals and institutions. Early pilot deployments highlighted the importance of simple interfaces, minimal buttons, and unobtrusive alerts. Users expressed a preference for vibration-based feedback over constant audio cues, particularly in crowded public environments. These insights informed improvements in device ergonomics, haptic feedback patterns, and multilingual voice output.

PathPal is primarily deployed through institutional partnerships including NGOs, schools for the visually impaired, rehabilitation centers, and government-supported programs. This distribution model ensures that users receive proper training and ongoing support. It also helps extend the technology to communities that may not have direct access to commercial assistive devices.

Overall, PathPal demonstrates how edge AI and human-centered design can be combined to create reliable assistive solutions for real-world environments. By integrating navigation assistance, reading support, and currency recognition into a single device, the system reduces dependence on multiple tools and enhances independence, safety, and confidence for visually impaired individuals.

For additional context and detailed documentation of this use case, please refer to pages 33-35 in the attached Casebook.