- Projects 4
- Followers 7
iOty
iOty is a project that implements DNNs at the edge for fast inference compared to a cloud-only approach. ...learn more
Project status: Under Development
Intel Technologies
Movidius NCS
Overview / Usage
Nowadays, the training phase of AI -- which is highly compute-intensive -- is being increasingly sped up by cloud computing. However, communicating with the cloud introduces latency during AI inference phase, which leads to poor performance for applications requiring 'hard' real-time responses from an on-premise location. We define "hard real-time" as a microsecond timescale, end-to-end, for a single batch of data communication and data processing. We propose iOty, a distributed architecture for accelerated DNNs on the edge. The main objective of the iOty project is to design and build an AI software and hardware system with real-time inference capabilities for edge applications that exhibit high-speed, massive dataset characteristics wherein communicating with the cloud directly would be impractical or too expensive.
Github: https://github.com/davenso/edgenn
Methodology / Approach
Intel (R) Movidius (TM) Neural Compute Stick (NCS) prototyping platform.
Technologies Used
Intel (R) Movidius (TM) Myraid 2 VPU
