Overview of OpenVINO™ Toolkit Intel’s Pre-Trained Models¶
OpenVINO™ toolkit provides a set of Intel’s pre-trained models that you can use for learning and demo purposes or for developing deep learning software. Most recent version is available in the repo on GitHub. The table Intel’s Pre-Trained Models Device Support summarizes devices supported by each model.
The models can be downloaded via Model Downloader.
Object Detection Models¶
Several detection models can be used to detect a set of the most popular
objects - for example, faces, people, vehicles. Most of the networks are
SSD-based and provide reasonable accuracy/performance trade-offs. Networks that
detect the same types of objects (for example, face-detection-adas-0001 and
face-detection-retail-0004) provide a choice for higher accuracy/wider
applicability at the cost of slower performance, so you can expect a “bigger”
network to detect objects of the same type better.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
364.21 |
52.79 |
|
2.835 |
1.053 |
|
1.067 |
0.588 |
|
0.982 |
1.021 |
|
0.785 |
1.828 |
|
1.767 |
1.842 |
|
2.405 |
1.851 |
|
2.853 |
2.392 |
|
339.597 |
69.920 |
|
12.427 |
3.244 |
|
2.300 |
0.723 |
|
7.140 |
1.951 |
|
8.225 |
2.001 |
|
7.140 |
1.951 |
|
7.138 |
1.951 |
|
0.786 |
1.817 |
|
1.768 |
1.817 |
|
3.143 |
1.817 |
|
6.519 |
2.394 |
|
79318.2158 |
55.557 |
|
370.208 |
51.164 |
|
24.758 |
3.630 |
|
404.264 |
71.565 |
|
2.836 |
1.165 |
|
3.974 |
1.650 |
|
2.798 |
1.079 |
|
0.786 |
1.817 |
|
1.768 |
1.817 |
|
3.143 |
1.817 |
|
3.964 |
1.178 |
|
3.560 |
2.887 |
|
65.984 |
61.922 |
|
0.787 |
1.821 |
|
1.770 |
1.821 |
|
3.163 |
1.821 |
|
6.550 |
2.416 |
|
1.811 |
2.327 |
|
0.349 |
0.634 |
|
3.598 |
3.212 |
|
0.986 |
1.338 |
|
29.38 |
48.29 |
|
29.38 |
48.29 |
|
29.38 |
48.29 |
|
6.975 |
15.12 |
|
6.975 |
15.12 |
|
6.975 |
15.12 |
|
5.424 |
11.229 |
|
1.077 |
0.8908 |
|
1.073 |
0.8894 |
|
1.077 |
0.8908 |
|
1.073 |
0.8894 |
Object Recognition Models¶
Object recognition models are used for classification, regression, and character recognition. Use these networks after a respective detector (for example, Age/Gender recognition after Face Detection).
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
0.094 |
2.138 |
|
0.105 |
1.911 |
|
0.328 |
1.218 |
|
0.126 |
0.626 |
|
0.462 |
11.177 |
|
0.126 |
2.483 |
|
0.021 |
0.191 |
|
0.6 |
9.66 |
|
0.042 |
4.595 |
|
0.174 |
0.735 |
|
2.167 |
23.510 |
|
1.034 |
21.797 |
|
0.139 |
1.882 |
Reidentification Models¶
Precise tracking of objects in a video is a common application of Computer Vision (for example, for people counting). It is often complicated by a set of events that can be described as a “relatively long absence of an object”. For example, it can be caused by occlusion or out-of-frame movement. In such cases, it is better to recognize the object as “seen before” regardless of its current position in an image or the amount of time passed since last known position.
The following networks can be used in such scenarios. They take an image of a person and evaluate an embedding - a vector in high-dimensional space that represents an appearance of this person. This vector can be used for further evaluation: images that correspond to the same person will have embedding vectors that are “close” by L2 metric (Euclidean distance).
There are multiple models that provide various trade-offs between performance and accuracy (expect a bigger model to perform better).
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
0.588 |
1.107 |
|
0.174 |
0.183 |
|
0.564 |
0.595 |
|
1.170 |
1.234 |
|
1.993 |
2.103 |
Semantic Segmentation Models¶
Semantic segmentation is an extension of object detection problem. Instead of returning bounding boxes, semantic segmentation models return a “painted” version of the input image, where the “color” of each pixel represents a certain class. These networks are much bigger than respective object detection networks, but they provide a better (pixel-level) localization of objects and they can detect areas with complex shape (for example, free space on the road).
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
4.770 |
0.184 |
|
58.572 |
6.686 |
|
260.1 |
31.03 |
|
151.82 |
25.45 |
|
151.82 |
25.45 |
|
151.82 |
25.45 |
Instance Segmentation Models¶
Instance segmentation is an extension of object detection and semantic segmentation problems. Instead of predicting a bounding box around each object instance instance segmentation model outputs pixel-wise masks for all instances.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
423.0842 |
48.3732 |
|
828.6324 |
101.236 |
|
147.2352 |
49.8328 |
|
13.9672 |
10.5674 |
|
29.334 |
13.5673 |
|
4.8492 |
7.2996 |
Human Pose Estimation Models¶
Human pose estimation task is to predict a pose: body skeleton, which consists of keypoints and connections between them, for every person in an input image or video. Keypoints are body joints, i.e. ears, eyes, nose, shoulders, knees, etc. There are two major groups of such methods: top-down and bottom-up. The first detects persons in a given frame, crops or rescales detections, then runs pose estimation network for every detection. These methods are very accurate. The second finds all keypoints in a given frame, then groups them by person instances, thus faster than previous, because network runs once.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
15.435 |
4.099 |
|
5.9393 |
8.1504 |
|
8.8720 |
8.1504 |
|
14.3707 |
8.1504 |
Image Processing¶
Deep Learning models find their application in various image processing tasks to increase the quality of the output.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
11.654 |
0.030 |
|
30.97 |
16.062 |
|
1.379 |
0.003 |
Text Detection¶
Deep Learning models for text detection in various applications.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
51.256 |
6.747 |
|
23.305 |
4.328 |
|
7.718 |
2.259 |
Text Recognition¶
Deep Learning models for text recognition in various applications.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
1.485 |
5.568 |
|
0.5442 |
2.839 |
|
encoder |
12.4 |
398 |
decoder |
0.03 |
4.33 |
encoder |
9.27 |
88.1 |
decoder |
0.08 |
4.28 |
0.792 |
5.555 |
|
117.136 |
15.31 |
|
134.513 |
17.270 |
|
1.3182 |
0.1413 |
|
encoder |
16.56 |
1.86 |
decoder |
1.69 |
2.56 |
encoder |
12.8447 |
0.2017 |
decoder |
8.6838 |
2.5449 |
Text Spotting¶
Deep Learning models for text spotting (simultaneous detection and recognition).
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
text-spotting-0005-detector |
184.495 |
27.010 |
text-spotting-0005-recognizer-encoder |
2.082 |
1.328 |
text-spotting-0005-recognizer-decoder |
0.002 |
0.273 |
Action Recognition Models¶
Action Recognition models predict action that is being performed on a short video clip
(tensor formed by stacking sampled frames from input video). Some models (for example driver-action-recognition-adas-0002 may use precomputed high-level spatial
or spatio-temporal) features (embeddings) from individual clip fragments and then aggregate them in a temporal model
to predict a vector with classification scores. Models that compute embeddings are called encoder, while models
that predict an actual labels are called decoder.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
driver-action-recognition-adas-0002-encoder |
0.676 |
2.863 |
driver-action-recognition-adas-0002-decoder |
0.147 |
4.205 |
action-recognition-0001-encoder |
7.340 |
21.276 |
action-recognition-0001-decoder |
0.147 |
4.405 |
6.660 |
4.133 |
|
4.227 |
4.113 |
|
3.636 |
11.173 |
Image Retrieval¶
Deep Learning models for image retrieval (ranking ‘gallery’ images according to their similarity to some ‘probe’ image).
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
0.613 |
2.535 |
Compressed models¶
Deep Learning compressed models
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
1.002 |
7.446 |
|
- |
- |
Question Answering¶
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
246.93 |
333.96 |
|
246.93 |
333.96 |
|
246.93 (for [1,384] input size) |
333.96 |
|
23.9 |
57.94 |
|
23.9 |
41.1 |
|
23.9 |
41.1 |
|
23.9 (for [1,384] input size) |
41.1 |
Machine Translation¶
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
23.17 |
69.29 |
|
23.17 |
69.29 |
|
23.19 |
77.47 |
|
23.19 |
77.47 |
Text To Speech¶
Deep Learning models for speech synthesis (mel spectrogram generation and wave form generation).
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
text-to-speech-en-0001-duration-prediction |
15.84 |
13.569 |
text-to-speech-en-0001-regression |
7.65 |
4.96 |
text-to-speech-en-0001-generation |
48.38 |
12.77 |
Deep Learning models for speech synthesis (mel spectrogram generation and wave form generation).
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
text-to-speech-en-multi-0001-duration-prediction |
28.75 |
26.18 |
text-to-speech-en-multi-0001-regression |
7.81 |
5.12 |
text-to-speech-en-multi-0001-generation |
48.38 |
12.77 |
Speech Noise Suppression¶
Deep Learning models for noise suppression.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
1.2 |
7.22 |
|
0.2 |
4.2 |
Time Series Forecasting¶
Deep Learning models for time series forecasting.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
0.40 |
2.26 |
Action Sequence Modeling¶
Deep Learning models for online sequence modeling.
Model Name |
Complexity (GFLOPs) |
Size (Mp) |
|---|---|---|
0.049 |
1.02 |
See Also¶
Legal Information¶
Caffe, Caffe2, Keras, MXNet, PyTorch, and TensorFlow are trademarks or brand names of their respective owners. All company, product and service names used in this website are for identification purposes only. Use of these names,trademarks and brands does not imply endorsement.