Indian Flag
Government Of India
A-
A
A+

Emergency Accessibility Relay (EAR): AI-Driven Multimodal Bridge for Emergency Communication

EAR is an AI-driven emergency communication platform that bridges communication gaps between persons with disabilities and emergency response systems using multimodal AI technologies.

About Use Case

Emergency Accessibility Relay (EAR) is an AI-driven communication system designed to bridge the gap between persons with disabilities and emergency response services. In emergency situations such as accidents, fires, or medical crises, rapid communication is critical. However, individuals with hearing, speech, or cognitive impairments often face barriers when attempting to contact emergency services or explain their situation effectively. EAR addresses these challenges by providing a multimodal communication bridge that ensures emergency services remain accessible to all individuals regardless of disability.

The system uses artificial intelligence to interpret and translate different communication modalities in real time. For individuals with hearing impairments, the platform can convert spoken instructions from emergency responders into text or visual formats. Conversely, users can communicate through text or gesture-based interfaces, which are then translated into speech for emergency operators.

For individuals with speech impairments, the system integrates augmentative and alternative communication tools that allow users to select or generate messages describing their emergency. AI models interpret these messages and convert them into clear spoken communication for responders.

Another important feature of EAR is contextual awareness. When a user initiates an emergency communication request, the system can automatically capture contextual data such as location, environment conditions, and possible hazards. This information is transmitted to emergency responders along with the user’s communication, enabling faster and more informed responses.

The system also supports multilingual communication, ensuring that language barriers do not delay emergency assistance. By combining speech recognition, translation technologies, and multimodal interaction interfaces, EAR creates an inclusive emergency communication infrastructure.

Overall, EAR demonstrates how AI can enhance public safety by ensuring that emergency communication systems are accessible to persons with disabilities.

For additional context and detailed documentation of this use case, please refer to pages 57-58 in the attached Casebook.

Source Organization Source Organization

IndiaAI

Tags Tags

  • Accessibility

Tags Sector

Governance and Administration

Resources Resources

External Resources:

Related Datasets Related Datasets

Updated 11 month(s) ago
VAANI: Multi-modal, Multi-lingual Dataset
VAANI: Multi-modal, Multi-lingual Dataset
Information-
VAANI is a multi-modal, multi-lingual dataset designed to represent the rich linguistic diversity of India. It currently includes data from two phases—Phase 1 (80 districts) and Phase 2 (40 districts)—spanning a total of ~21,500 hours of spontaneous, image-prompted speech collected from more than 110K speakers across 120 districts, describing 210K images in 86 languages. From this, 835 hours of transcribed audio data is available, distributed nearly evenly across all 120 districts.
Bengali
Gujarati
Kannada
Nepali
Punjabi
Telugu
Urdu
Sindhi
English
Tamil
Low-Resource Languages
Marathi
Malayalam
Odia
speech transcription
spontaneous speech
Sangtam
Ao
Halbi
Malvi
Sadri
Chhattisgarhi
Bhili
Malvani
multilingual corpus
Sumi
Bagheli
Khorth
Nyishi
multimodal dataset
Shekhawati
Bagri
Mewati
Meitei
86 Indian languages
Surgujia
audio-visual dataset
Garo
MagadhiMagahi
TTS training
Wancho
Awadhi
Galo
Oriya
speech + image + text
Tenyidie
regional dialects
Rajbanshi
Nagamese
manual transcription
Thethi
LLM speech integration
KhorthKhotta
Konkani
quality evaluated
speaker identification
diverse demographics
telemedicine AI applications
Marwadi
speaker diversity
Tulu
Assamese
Harauti
Rajasthani
language identification
120+ districts
Tagin
Marwari
Gondi
Bajjika
22 Indian states
Surjapuri
dialect diversity
Kokborok
image-prompted data
Santali
speech enhancement
Khariboli
Rengma
geo-centric data collection
Hajong
Hindi
ASR training
Wagdi
Bhatri
Dorli
multi-modal language resources
reallife recording environments
Mewari
linguistic diversity
Nimadi
Khandeshi
data for conversational AI
benchmarking dataset
Lotha
Kurmali
Bhojpuri
NissiDafla
Angika
Lambani
Magahi
Jaipuri
Bihari
Chakhesang
Magadhi
Angami
Chakma
Duruwa
Bearybashe
Khortha
Kumaoni
Kurukh
Garhwali
Maithili
Agariya
Bundeli
large-scale speech corpus
  • See Upvoters1
  • Downloads139
  • File Size0
  • Views1,407

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE