Hugging Face's logo

qualcomm
/
ResNet-Mixed-Convolution

Video Classification
PyTorch
backbone
android
Model card Files
xet
 Community
1

ResNet-Mixed-Convolution: Optimized for Qualcomm Devices

ResNet Mixed Convolutions is a network with a mixture of 2D and 3D convolutions used for video understanding.

This is based on the implementation of ResNet-Mixed-Convolution found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.50, ONNX Runtime 1.30.0 Download
ONNX w8a16 Universal QAIRT 2.50, ONNX Runtime 1.30.0 Download
ONNX w8a8 Universal QAIRT 2.50, ONNX Runtime 1.30.0 Download
QNN_DLC float Universal QAIRT 2.50 Download
QNN_DLC w8a16 Universal QAIRT 2.50 Download
QNN_DLC w8a8 Universal QAIRT 2.50 Download
TFLITE float Universal QAIRT 2.50 Download
TFLITE w8a8 Universal QAIRT 2.50 Download

For more device-specific assets and performance metrics, visit ResNet-Mixed-Convolution on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for ResNet-Mixed-Convolution on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.video_classification

Model Stats:

  • Input resolution: 112x112
  • Model checkpoint: Kinetics-400
  • Model size (float): 44.6 MB
  • Model size (w8a16): 11.5 MB
  • Number of parameters: 11.7M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
ResNet-Mixed-Convolution ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.74 ms 1 - 206 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® 8 Elite For Galaxy Mobile 7.692 ms 0 - 198 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® X2 Elite 10.985 ms 2 - 2 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® X Elite 13.563 ms 22 - 22 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® 8 Gen 3 Mobile 9.499 ms 2 - 253 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® 8 Gen 1 Mobile 24.114 ms 2 - 219 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ IQ-8275 28.204 ms 2 - 6 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 13.09 ms 0 - 24 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® QCS8450 24.114 ms 2 - 219 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ IQ-9075 25.424 ms 2 - 6 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ IQ-X7181 13.563 ms 22 - 22 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ Q-8750 7.692 ms 0 - 198 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.674 ms 0 - 194 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 5.217 ms 1 - 179 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® X2 Elite 4.681 ms 1 - 1 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® X Elite 8.795 ms 12 - 12 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 6.35 ms 1 - 236 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 11.286 ms 1 - 238 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 36.215 ms 1 - 4 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 9.497 ms 1 - 5 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 8.502 ms 0 - 15 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® QCS8450 11.286 ms 1 - 238 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 8.301 ms 1 - 4 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 8.795 ms 12 - 12 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 174.377 ms 0 - 193 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 16.532 ms 1 - 193 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 5.217 ms 1 - 179 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 16.532 ms 1 - 193 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 1.857 ms 0 - 173 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 2.746 ms 0 - 173 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® X2 Elite 2.313 ms 2 - 2 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® X Elite 4.724 ms 11 - 11 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 3.25 ms 0 - 212 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 5.854 ms 1 - 211 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 18.381 ms 1 - 4 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 4.983 ms 1 - 5 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 4.645 ms 0 - 15 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® QCS8450 5.854 ms 1 - 211 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 4.443 ms 1 - 4 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 4.724 ms 11 - 11 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 95.404 ms 0 - 181 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 8.011 ms 1 - 171 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 2.746 ms 0 - 173 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 8.011 ms 1 - 171 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.874 ms 2 - 208 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 7.75 ms 0 - 200 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® X2 Elite 7.717 ms 2 - 2 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® X Elite 13.993 ms 2 - 2 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® 8 Gen 3 Mobile 9.55 ms 2 - 256 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® 8 Gen 1 Mobile 24.282 ms 2 - 217 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 28.474 ms 2 - 7 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 13.317 ms 2 - 4 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® QCS8450 24.282 ms 2 - 217 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 25.536 ms 4 - 9 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 13.993 ms 2 - 2 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ Q-8750 7.75 ms 0 - 200 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® SA8295P 26.95 ms 0 - 173 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.794 ms 1 - 185 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 5.438 ms 1 - 179 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® X2 Elite 5.264 ms 1 - 1 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® X Elite 9.234 ms 1 - 1 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 6.474 ms 0 - 232 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 11.071 ms 1 - 234 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 37.178 ms 1 - 4 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 9.579 ms 1 - 5 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 8.599 ms 1 - 3 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA8775P 8.591 ms 1 - 181 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA8650P 8.591 ms 1 - 181 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA8255P 8.591 ms 1 - 181 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® QCS8450 11.071 ms 1 - 234 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 8.351 ms 1 - 4 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 9.234 ms 1 - 1 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 171.825 ms 1 - 192 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 16.757 ms 1 - 191 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 5.438 ms 1 - 179 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA7255P 30.001 ms 1 - 180 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA8295P 15.779 ms 1 - 186 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 16.757 ms 1 - 191 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 1.906 ms 0 - 169 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 2.764 ms 0 - 174 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® X2 Elite 2.691 ms 1 - 1 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® X Elite 5.074 ms 1 - 1 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 3.332 ms 0 - 208 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 6.206 ms 1 - 208 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 18.372 ms 1 - 3 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 5.051 ms 1 - 4 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 4.621 ms 1 - 2 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® QCS8450 6.206 ms 1 - 208 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 4.512 ms 3 - 5 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 5.074 ms 1 - 1 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 94.008 ms 1 - 180 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 7.897 ms 1 - 166 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 2.764 ms 0 - 174 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® SA7255P 16.413 ms 1 - 166 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® SA8295P 8.55 ms 0 - 164 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 7.897 ms 1 - 166 MB NPU
ResNet-Mixed-Convolution TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 179.887 ms 0 - 236 MB NPU
ResNet-Mixed-Convolution TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 191.251 ms 0 - 230 MB NPU
ResNet-Mixed-Convolution TFLITE float Snapdragon® 8 Gen 3 Mobile 191.339 ms 0 - 279 MB NPU
ResNet-Mixed-Convolution TFLITE float Snapdragon® 8 Gen 1 Mobile 300.442 ms 0 - 262 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ IQ-8275 258.177 ms 0 - 30 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 255.48 ms 0 - 2 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA8775P 258.949 ms 0 - 226 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA8650P 258.949 ms 0 - 226 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA8255P 258.949 ms 0 - 226 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® QCS8450 300.442 ms 0 - 262 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ IQ-9075 261.853 ms 0 - 29 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ Q-8750 191.251 ms 0 - 230 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA7255P 500.714 ms 0 - 224 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA8295P 312.013 ms 0 - 213 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 357.571 ms 0 - 316 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 350.352 ms 0 - 256 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 413.903 ms 0 - 332 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 669.939 ms 0 - 328 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 1763.25 ms 693 - 1059 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 549.973 ms 0 - 29 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 543.533 ms 0 - 2 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA8775P 610.281 ms 1 - 279 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA8650P 610.281 ms 1 - 279 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA8255P 610.281 ms 1 - 279 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® QCS8450 669.939 ms 0 - 328 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 612.63 ms 0 - 28 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 1526.511 ms 655 - 807 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 1228.072 ms 691 - 868 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 350.352 ms 0 - 256 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA8295P 623.121 ms 0 - 281 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 1228.072 ms 691 - 868 MB NPU

License

  • The license for the original implementation of ResNet-Mixed-Convolution can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
Video Classification
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/ResNet-Mixed-Convolution