QAT(quantize aware training) for classification with MQBench

Last update: Nov 18, 2022

Overview

MQBench Quantization Aware Training with PyTorch

I am using MQBench(Model Quantization Benchmark)(http://mqbench.tech/) to quantize the model for deployment.

MQBench is a benchmark and framework for evluating the quantization algorithms under real world hardware deployments.

Prerequisites

Python 3.7+
PyTorch 1.8.1+

Install MQBench Lib

Before run this repository, you should install MQBench:

git clone https://github.com/ModelTC/MQBench.git
cd MQBench
python setup.py build
python setup.py install

Training Fp32 Model

# Start training fp32 model with: 
# model_name can be ResNet18, MobileNet, ...
python main.py model_name

# You can manually config the training with: 
python main.py --resume --lr=0.01

Training Quantize Model

# Start training quantize model with: 
# model_name can be ResNet18, MobileNet, ...
python main.py model_name --quantize

# You can manually config the training with: 
python main.py --resume --parallel DP --BackendType Tensorrt --quantize
python -m torch.distributed.launch main.py --local_rank 0 --parallel DDP --resume  --BackendType Tensorrt --quantize

Fp32 Accuracy

Model	Acc.
VGG16	92.64%
ResNet18	93.02%
ResNet50	93.62%
ResNet101	93.75%
RegNetX_200MF	94.24%
RegNetY_400MF	94.29%
MobileNetV2	94.43%
ResNeXt29(32x4d)	94.73%
ResNeXt29(2x64d)	94.82%
SimpleDLA	94.89%
DenseNet121	95.04%
PreActResNet18	95.11%
DPN92	95.16%
DLA	95.47%

QAT(quantize aware training) for classification with MQBench

Related tags

Overview

MQBench Quantization Aware Training with PyTorch

Prerequisites

Install MQBench Lib

Training Fp32 Model

Training Quantize Model

Fp32 Accuracy

Owner

Ling Zhang

Evolutionary Population Curriculum for Scaling Multi-Agent Reinforcement Learning

SEAN: Image Synthesis with Semantic Region-Adaptive Normalization (CVPR 2020, Oral)

sktime companion package for deep learning based on TensorFlow

Code for paper: Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networks

An original implementation of "Noisy Channel Language Model Prompting for Few-Shot Text Classification"

Using Random Effects to Account for High-Cardinality Categorical Features and Repeated Measures in Deep Neural Networks

Code release for "Making a Bird AI Expert Work for You and Me".

Implementation of StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation in PyTorch

The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training

Post-training Quantization for Neural Networks with Provable Guarantees

This repository is for EMNLP 2021 paper: It is Not as Good as You Think! Evaluating Simultaneous Machine Translation on Interpretation Data

Official Implementation of DE-CondDETR and DELA-CondDETR in "Towards Data-Efficient Detection Transformers"

Code to replicate the key results from Exploring the Limits of Out-of-Distribution Detection

Self-Supervised Learning of Event-based Optical Flow with Spiking Neural Networks

Code for weakly supervised segmentation of a single class

Demonstration of the Model Training as a CI/CD System in Vertex AI

DeepProbLog is an extension of ProbLog that integrates Probabilistic Logic Programming with deep learning by introducing the neural predicate.

This repo contains implementation of different architectures for emotion recognition in conversations.

A stock generator that assess a list of stocks and returns the best stocks for investing and money allocations based on users choices of volatility, duration and number of stocks

Implementation for Simple Spectral Graph Convolution in ICLR 2021