- Projects 18
- Followers 11
HoloXR Edu
HoloXR uses VR and AR to create a live view of a real-world environment (“reality”) with computer-generated input (sound, 3D Machinery graphics, 3D text, 360 video, and GPS information) and thus supplementing (“augmenting”) the visual elements in the view. Using 3-D AR systems enables real tasks to be completed with the help of virtual agents. 3-D AR, mechanical technology learners disassembling an engine will see live, real-time directions overlaid on the parts set out in front of them, and a 360 video showing exactly what steps to take next. We use object detection and segmentation software to create high-quality and accurate content for computer-aided design (CAD) models. ...learn more
Project status: Published/In Market
Virtual Reality, Mobile, Game Development, Artificial Intelligence
Intel Technologies
Intel GPA
Overview / Usage
The Key Challenges that are inherent in the technical education sector in the Republic of South Africa:
• Infrastructure, outdated equipment and machinery; teachers were not up to date with the trends of industry;
• Learning and teacher support material (LTSM), which requires updating;
• The collapse of partnerships that existed between Technical Schools and industry, which has created a major gap in affording learners work experience whilst affording industries an opportunity to contribute to schools in preparing learners for the world of work.
•The above have negative ramifications in terms of learner participation and teacher retention Instructional Augmented Reality for Technology Education
Methodology / Approach
Educational objective:
Real time access to virtual equipment and machinery, linking movements and AR feedback systems, to enhance task performance on cognitive tasks.
Implementation and context:
Quite fine granular registration of real world overlays is used to implement instructional environments in AR.
Main Components
Virtual Media: 3D Equipment and machinery
Sharing virtual media: Learners may share 3D models or link to real world objects for other learners to access.
Collaboration: Learners may collaborate on completing cognitive tasks
Educator Portal: Teachers may assign tasks to learners and use the dashboard to obtain learner progress
Main Users: Learners and Teachers
Technologies Used
Tools and SDK:
These are the tools used to generate debug and optimize content
We use vuforia for digital content storage and augmenting 3D models.
We use opencv for background segementation and object tracking
Intel® GPA (Intel GPA is a powerful, free graphics performance analyzer tool, which can be downloaded at https://software.intel.com/en-us/gpa)
System Analyzer: Real-time display of game performance indicators.
Graphics Frame Analyzer: The frame analyzer.
Platform Analyzer: Locates the CPU and GPU workloads.
Graphics Trace Analyzer: Captures detailed event traces for other analyzer analysis.
Middleware:
Unity3D Game Engine was used as the Optimized Middleware for 3D graphiics rendering, analytics and infrastructure
Drivers:
DirectX 12 and Vulkan where used to optimize system-level latency reduction, tuning and api acceleration
Operating System:
Our application is optimized for Andriod and Apple iOS
Repository
https://github.com/TebogoNakampe/HoloXR_EDU
Other links
Collaborators