Large Scale Inference Engine
- 0 Collaborators
an deep learning model inference engine, model miniaturization, deployment toolchains for large scale model. ...learn more
Project status: Concept
oneAPI, HPC, Artificial Intelligence
Intel Technologies
DevCloud,
oneAPI,
Intel Opt ML/DL Framework
Overview / Usage
As the amount of data increases, larger models have stronger expressive power. From natural language processing model to computer vision model, then to multimodal model, Pangu. How to deploy and use super large model is a challenging problem. It is very important to develop a tool chain for miniaturization and deployment of a set of models.