A visual aid glasses for visually impaired or blind people

A visual aid glasses for visually impaired or blind people

In a nutshell, I want to make glasses for the visually impaired which can help them "seeing" things by hearing.

Artificial Intelligence

  • 0 Collaborators

  • 1 Followers

    Follow

Description

In the prototype version, I am proposing to include 3 main features for the user:

  1. What is in front of the user? This is probably the best feature of the glass as It will help them directly see what the glasses are seeing. This will be solved by any simple Image classification deep learning framework or some advanced versions of a classification framework using transfer learning just as in the paper, which I coauthored - the rice classification model using transfer learning.

  2. The direction of the things of which are in the way. The user can know from which direction a person or an animal is coming or where is a chair etc. This can be done using image segmentation. Which can be done using a pretty standard deep learning framework of image translation GANs.

  3. Image Captioning. Now, this feature is more advanced and may not be handled by the Neural Compute Stick. But, if I can incorporate this feature also in the glasses then the product will have a personal touch. This can be done by image captioning models using a mixture of CNN and RNN and can be improved using augmentation methods which I have proposed in the Image captioning project.

If this project gets funding then it would be a great thing for the visually impaireds.

Image source: https://www.google.co.in/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjH-qXTwZPXAhVMK48KHTqNC3AQjRwIBw&url=https%3A%2F%2Fwww.trendhunter.com%2Ftrends%2Fnavigation-blind-sunglasses&psig=AOvVaw1OrqFx63CW0RPwSIqj244K&ust=1509286797322541 https://www.google.co.in/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjck_K7wpPXAhXJsY8KHWKMBxYQjRwIBw&url=https%3A%2F%2Fdevblogs.nvidia.com%2Fparallelforall%2Fimage-segmentation-using-digits-5%2F&psig=AOvVaw1D2WBYTN-zczWSvfbsr1U9&ust=1509287028458170

https://www.google.co.in/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwiT4a60wpPXAhVKL48KHRnyCzAQjRwIBw&url=https%3A%2F%2Fpdollar.wordpress.com%2F2015%2F01%2F21%2Fimage-captioning%2F&psig=AOvVaw0WQdHSaIOkiODS43SOU2k5&ust=1509287013573282 (Just for reference)

Gallery

Medium screenshot from 2017 08 10 23 09 03

Vaibhav P. created project A visual aid glasses for visually impaired or blind people

Medium a011334b 5f3e 45cf bab0 e4e96ccfc210

A visual aid glasses for visually impaired or blind people

In the prototype version, I am proposing to include 3 main features for the user:

  1. What is in front of the user? This is probably the best feature of the glass as It will help them directly see what the glasses are seeing. This will be solved by any simple Image classification deep learning framework or some advanced versions of a classification framework using transfer learning just as in the paper, which I coauthored - the rice classification model using transfer learning.

  2. The direction of the things of which are in the way. The user can know from which direction a person or an animal is coming or where is a chair etc. This can be done using image segmentation. Which can be done using a pretty standard deep learning framework of image translation GANs.

  3. Image Captioning. Now, this feature is more advanced and may not be handled by the Neural Compute Stick. But, if I can incorporate this feature also in the glasses then the product will have a personal touch. This can be done by image captioning models using a mixture of CNN and RNN and can be improved using augmentation methods which I have proposed in the Image captioning project.

If this project gets funding then it would be a great thing for the visually impaireds.

Image source: https://www.google.co.in/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjH-qXTwZPXAhVMK48KHTqNC3AQjRwIBw&url=https%3A%2F%2Fwww.trendhunter.com%2Ftrends%2Fnavigation-blind-sunglasses&psig=AOvVaw1OrqFx63CW0RPwSIqj244K&ust=1509286797322541 https://www.google.co.in/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjck_K7wpPXAhXJsY8KHWKMBxYQjRwIBw&url=https%3A%2F%2Fdevblogs.nvidia.com%2Fparallelforall%2Fimage-segmentation-using-digits-5%2F&psig=AOvVaw1D2WBYTN-zczWSvfbsr1U9&ust=1509287028458170

https://www.google.co.in/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwiT4a60wpPXAhVKL48KHRnyCzAQjRwIBw&url=https%3A%2F%2Fpdollar.wordpress.com%2F2015%2F01%2F21%2Fimage-captioning%2F&psig=AOvVaw0WQdHSaIOkiODS43SOU2k5&ust=1509287013573282 (Just for reference)

No users to show at the moment.

Bigger bob duffy 3d head avatar
  • Projects 4
  • Followers 126

Bob Duffy

Folsom, CA, USA