Overview / Usage

3D game in Unreal Engine in which you can teach sign language to the children.
We will create hands in a 3D environment, in which children can learn the signs alphabet by seeing hands in 3D.

Children will find a virtual environment in which they can learn sign language through play and learn the basics rule of this particular language.

In the same environment, there will also be a lot of another games, such as the following:

• by clicking on the hands, children will write the name of the corresponding meaning ;
• by seeing the correct sequence of hands, children will build the corresponding word;
• children will learn simple phrases by viewing short 3D reconstructions;
• (possible evolution) children will use realsense to capture hand movements and improve own sign language.

In addition, for improve inclusion, we will create video courses and streaming online with OBS to help children in the best way.

Methodology / Approach

Software projects include a series of stages: requirement analysis, specification, design, coding, compilation and execution.

Step 1: interview with children to understand the best process to create the game. In this step, **Touchscreen **of the ASUS VivoBook will be used to be able to interview the children and, in addition,as an input method for the game.

Step 2: Create various storytelling to explain the world of sign language through the game;

Step 3: Create animations in Adobe After Effect to enhance the graphics

Step 4: Create hands in 3D object with various signs in Unreal Engine.

Step 5: (optional step): create video tutorials with OBS to increase learning.

​

We will be using ASUS VivoBook Flip with Intel Xe Max to understand the performance increase, using 3d modeling programs such as Unreal Engine, Adobe After Effect and OBS. In fact, these programs need GPU models with good performance to work smoothly.

We will also test the performance and temperatures of the processor and laptop in general.

Technologies Used

For this project, we will use different graphics technologies and software, such as the following:

• ASUS VivoBook Flip 14 with Intel Xe Max, as a hardware system for creating graphics, creating video and sound effects and final rendering.
• Unreal Engine, Create Hands, ambient 3D, gamification and create the videogame.
• Adobe Creative Cloud, in particular Adobe After Effect, create visual effects to import in Unreal Engine
• OBS, to create a online courses
• Intel REAL SENSE D415, to capture the movement (next feature)

​

Repository

https://github.com/gino983/3dSignLanguageGame.git