AN INNOVATIVE KINESTHETIC COMPANION FOR CHILDREN WITH AUTISM SPECTRUM DISORDER
- 0 Collaborators
Autism Spectrum Disorder (ASD) as defined as a condition or disorder that begins in childhood and that causes problems in forming relationships and communicating with other people. Aarya works as a personal well-being companion to children with Autism Spectrum Disorder while they interact with a virtual environment that is gesture based. By making a child with ASD face real world situations we aim to improve his/her confidence in facing the world and being open to learning various skills. Social interaction and communication are the major challenges faced by children with ASD. Kinect is a line of motion sensing input devices by Microsoft for Xbox 360 and Xbox One gaming console. Based around a webcam-style add-on peripheral, it enables users to control and interact with their console or computer without the need for a game controller, through a natural user interface using gestures and spoken commands. In Aarya we use gesture based interface that is the Microsoft Kinect so that the child can find it easier to interact in the real-world environment. Through the interactions made with the children and the results obtained, we understand that this tool can be a companion while giving chance for growth and improving their interactive ability. Aarya can help children become fully engaged and immersed in kinesthetic learning activities that stimulate the brain and cultivate several skills. Aarya is filled with activities that use the Kinect’s motion and speech sensing technology that encourages the child to move around and learn in a fun and encouraging atmosphere ...learn more
Project status: Published/In Market
Intel Technologies
Intel NUC,
Intel Python
Overview / Usage
This project uses the Kinect motion sensor to get input in the form of gestures. This input is then transferred to the computer and the software used is Kinect2Scratch. This software is used to configure and analyze the body movements and connects these inputs to Scratch. In Scratch, the positions of the joints in a human body are analyzed and once the required movement is recognized, Scratch processes this data and the flow of control is transferred to the next module. It then gives the next instruction.
Methodology / Approach
- Please refer to the Architecture Diagram.
- Please refer to the Workflow Diagram.
Both of them shall give an idea about the workflow!
Technologies Used
Kinect motion sensor, Scratch, AI