madad initiative- An Assistive smart wearable and application designed for people with hearing disabilities

kazi haque

kazi haque

Kolkata, West Bengal

1 0
  • 0 Collaborators

AI and IoT based Accessibility Track for specially abled people for 1. Public Announcement Decipher and Emergency situation awareness 2. Navigation of new areas for deaf and mute people 3. Sharing SOS signals in case of emergency ...learn more

Project status: Under Development

Mobile, Internet of Things, Artificial Intelligence

Groups
DeepLearning, Internet of Things

Intel Technologies
DevCloud, Movidius NCS, OpenVINO, Intel Python

Links [1]

Overview / Usage

Challenges faced by people with hearing disability in day to day life can be categorized into :

1. Difficulty in hearing announcements in public places++

Imagine a situation where a deaf and mute person is not able to hear any Emergency announcement , such as "There is a Fire! Please evacuate the premise"** **or any generic announcement of importance such as while traveling in a metro or bus to "Please get down in the next station , the metro will change tracks" ,a normal person with hearing ability would do as per the announcements ,but imagine a deaf persons ordeal .

Solution : Announcement Interpretation

A smart wearable device with a complementary iOS app that provides assistance during emergency situations by interpreting announcements and generating alerts in Sign language .

Please go through the link below for a demo of the application:

https://drive.google.com/file/d/1eFZOc7P0pMIg2hRNj8y8KLaG86ZI7L3h/view?usp=sharing

2. Navigation of new areas

Imagine a deaf person going to a new place and as he or she is not able to understand the different announcements such as timing of the place or to find the ticket counter, he faces a lot of difficulty . A stats also suggest that more then 90% of deaf and mute people are not able to read or write and understand sign language only .

Solution :Know Your Surrounding

Shows important instructions in sign language specific to the users' location.

3.Sharing SOS signals in emergency

Imagine a situation where a deaf and mute person is not able to communicate an emergency situation like fire or some sort of violence because of his disability.

Solution:SOS Signals

Sends SOS signals to concerned authorities with current location and messages as per situation.

Also a feature is enable for the users to record there videos in Sign Language whoch will be interpreted as text and send to concerned authorities

Please go through the link below for a demo of the application:

https://drive.google.com/file/d/1eGB3ui-fzU1pNNLeUnev9800mmmr32v4/view?usp=sharing

Prototype is developed for the above three solutions with a smart wearable and a complimentary iOs app for all the solutions.

Please go through the link below for the product details:

http://bit.ly/MadadPitch

Methodology / Approach

Technologies & Features

  • iOs application “madad”
  • IoT based smart wearable for real time analysis
  • Digital Signal Processing(DSP) algorithm for noise reduction
  • Artificial Intelligence algorithms for transcribing, translation and announcement categorization
  • GPS based tracking for emergency alerts

Technologies Used

  • Intel Optimized python version is used for the complete development of the application
  • Intel OpenVino toolkit is used for gesture and facial recognition
  • up squared AI Vision kit is used for inferencing and deployment

Please visit the below link for a demonstration :

http://bit.ly/Madad_AI_ALGO

Comments (0)