DevMesh

A-eye

Dev Aryan Khanna

Dev Aryan Khanna

Delhi

4 1

The project develops smart glasses for visually impaired people, using IoT, AI, and OpenCV. The glasses connect to the internet, utilize AI for object recognition, provide audio instructions/alerts, offer navigation assistance, and support voice commands. Its goal is to enhance mobility&independence ...learn more

Project status: Under Development

Artificial Intelligence, Cloud, Internet of Things, Mobile, Networking, PC Skills, Robotics, Virtual Reality

Intel Technologies
DevCloud, oneAPI, Intel Integrated Graphics, Intel FPGA, Intel GPA, Intel Python, Intel CPU, Intel Opt ML/DL Framework

Code Samples [1]

Overview / Usage

The smart glasses project is an ambitious endeavor aimed at addressing the challenges faced by visually impaired individuals. Through the integration of cutting-edge technologies, such as IoT, AI, GPS, and Intel oneAPI, the project seeks to provide a comprehensive assistive device that enhances users' mobility, independence, and overall quality of life.

By incorporating IoT capabilities, the glasses enable real-time communication, data analysis, and access to online resources, expanding users' reach and connectivity. Utilizing AI algorithms, the glasses can process visual data captured by an integrated camera, allowing for object recognition and text identification. The glasses deliver audio feedback and alerts through speakers or voice assistants like Alexa, offering spoken instructions, descriptions, and timely alerts about users' surroundings and potential obstacles.

In addition, the combination of AI, IoT, and GPS technologies enables the glasses to provide navigation assistance. Users can navigate unfamiliar areas, recognize landmarks, and receive turn-by-turn directions, enhancing their ability to travel independently and with confidence. Voice recognition capabilities further facilitate interaction with the device, allowing users to control functionalities, retrieve information, and adjust settings through voice commands.

The project also utilizes oneAPI to optimize the performance of the AI algorithms used in the glasses. The use of oneAPI enables the integration of multiple processing units, including CPUs, GPUs, and FPGAs, to enhance the performance of the AI algorithms in the glasses. This integration enables faster processing of visual data, resulting in real-time feedback and a more seamless user experience.

Overall, the smart glasses project seeks to provide a valuable tool for visually impaired individuals, enhancing their independence, mobility, and overall quality of life. In production, the glasses would be experienced as a wearable device that enables users to perceive and interact with their surroundings more effectively, thus enhancing their independence and mobility. The project represents a significant contribution to assistive technology, demonstrating the potential for cutting-edge technologies to positively impact the lives of individuals with disabilities.

Methodology / Approach

I would like to explain methodology of my project in following points:-

  1. Problem Identification: The project identifies the challenges faced by visually impaired individuals in navigating their surroundings and aims to develop a solution that enhances their mobility and independence.
  2. Technological Integration: The project integrates various cutting-edge technologies to create smart glasses that provide comprehensive assistance. These technologies include:
  3. IoT capabilities: The glasses connect to the internet, enabling real-time communication, data analysis, and access to online resources. This connectivity allows for enhanced functionality and access to online services.
  4. AI algorithms: The glasses leverage AI algorithms, potentially using OpenCV, to process visual data captured by an integrated camera. These algorithms enable object recognition, text identification, and a deeper understanding of the user's environment.
  5. Audio feedback and alerts: The glasses provide audio instructions, descriptions, and timely alerts about the user's surroundings and potential obstacles. This audio feedback is delivered through speakers or a voice assistant like Alexa, enhancing the user's awareness and safety.
  6. Navigation assistance: By combining AI, IoT, and GPS technologies, the glasses offer navigation assistance. Users can navigate through unfamiliar areas, recognize landmarks, and receive turn-by-turn directions, improving their mobility and ability to explore new environments.
  7. Voice recognition: The glasses may support voice recognition, enabling users to interact with the device through voice commands. This functionality provides convenient control over functionalities, information retrieval, and settings adjustment.
  8. Frameworks and Standards: The specific frameworks and standards used in the development of the project may vary. For example, OpenCV can be employed for image processing and object recognition tasks. Additionally, relevant standards and guidelines for accessibility and user experience design may be considered to ensure the glasses are user-friendly and inclusive.
  9. Iterative Development: The project may follow an iterative development process, where prototypes are built, tested, and refined based on user feedback and requirements. This approach allows for continuous improvement and ensures that the final product meets the needs of visually impaired individuals effectively.
  10. Utilizing Intel oneAPI: The project may leverage Intel oneAPI, which is a unified software programming environment that supports multiple architectures and allows for optimized performance across various hardware platforms. By using oneAPI, the project can take advantage of hardware acceleration and optimize the performance of the AI algorithms and other computations involved in the smart glasses' operation. This can result in faster and more efficient processing, which can ultimately improve the user experience for visually impaired individuals.

Overall, the project combines IoT, AI, and other technologies to create smart glasses that provide a range of functionalities to assist visually impaired individuals in navigating their surroundings. The aim is to enhance their mobility, independence, and overall quality of life.

Technologies Used

Technologies, libraries, tools, software, hardware, and Intel technologies that may be used in the development of the smart glasses project include:

​

1: IoT Technologies:

Internet connectivity protocols (Wi-Fi, Bluetooth, cellular)

IoT development platforms (Raspberry Pi)

Cloud services for data storage and analysis (AWS IoT, Google cloud IoT)

​

2: AI and Computer Vision Technologies:

AI frameworks and libraries (TensorFlow, PyTorch)

Computer vision libraries (OpenCV)

Deep learning models for object recognition and image analysis

​

3: Speech Recognition and Voice Assistants:

Speech recognition libraries and APIs (Google Cloud Speech-to-Text)

Voice assistant platforms (Amazon Alexa)

​

4: Navigation and Location Technologies:

GPS (Global Positioning System) for location tracking

Navigation frameworks and APIs (Google Maps API)

​

5: Voice User Interface (VUI) Development:

Voice user interface design tools

Natural language processing (NLP) libraries and APIs for voice commands processing

​

6: Hardware Components:

Camera module for capturing visual data

Speakers or headphones for audio feedback

Microphone for voice input

GPS module for location tracking

​

7: Intel Technologies:

Intel processors for running AI algorithms and processing data

Intel RealSense depth cameras for advanced vision capabilities (To be Added)

Intel IoT development kits and boards for prototyping and connectivity

​

8: Development Tools and Software:

Integrated Development Environments (Visual Studio)

Version control systems (Git)

Programming languages (Python)

9: oneAPI: oneAPI is used to enhance the performance of the AI algorithms used in the smart glasses. oneAPI enables the integration of multiple processing units, including CPUs, GPUs, and FPGAs, to optimize the performance of the AI algorithms in the glasses. This integration enables faster processing of visual data, resulting in real-time feedback and a more seamless user experience.

Repository

https://github.com/aryankhanna208/Aeye

Collaborators

6 Results

6 Results

Comments (1)