STBP is a way to train SNN with datasets by Backward propagation.

Last update: Dec 09, 2022

Overview

Train SNN with STBP in fp32 and low bit(quantize)

Spiking neural network (SNN), compared with depth neural network (DNN), has faster processing speed, lower energy consumption and more biological interpretability, which is expected to approach Strong AI.

STBP is a way to train SNN with datasets by Backward propagation.Using this Repositories allows you to train SNNS with STBP and quantize SNNS with QAT to deploy to neuromorphological chips like Loihi and Tianjic.

Usage

Download via GitHub:

git clone https://github.com/ZLkanyo009/STBP-train-and-compression.git

example to define SNN_layers like ANN_layers

Convert layer to spatiotemporal layer:

conv = nn.Conv2d(...)
conv_s = tdLayer(conv)

Define LIF activation function just like Relu:

spike = LIFSpike()

In the forward function, replace the activation function of each layer with LIF activation function, and replace the calls such as conv() with conv_ s(), then SNN_layers definition is completed.Finally, we use Frequency Coding to decode SNN's output like out = torch.sum(x, dim=2) / steps

def forward(self, x):
    x = self.conv1_s(x)
    x = self.spike(x)
    x = self.pool1_s(x)
    x = self.spike(x)
    x = x.view(x.shape[0], -1, x.shape[4])
    x = self.fc1_s(x)
    x = self.spike(x)
    out = torch.sum(x, dim=2) / steps
    return out

If BN layer is required:

bn = nn.BatchNorm2d(...)
bn = tdBatchNorm(...)
conv_s = tdLayer(conv, bn)

Training Fp32 Model

# Start training fp32 model with: 
# model_name can be ResNet18, CifarNet, ...
python main.py ResNet18 --dataset CIFAR10

# training with DDP:
python -m torch.distributed.launch main.py ResNet18 --local_rank 0 --dataset CIFAR10 --p DDP

# You can manually config the training with: 
python main.py ResNet18 --resume --lr 0.01

Training Quantize Model

# Start training quantize model with: 
# model_name can be ResNet18, CifarNet, ...
python main.py ResNet18 --dataset CIFAR10 -q

# training with DDP:
python -m torch.distributed.launch main.py ResNet18 --local_rank 0 --dataset CIFAR10 -q --p DDP

# You can manually config the training with: 
python main.py ResNet18 -q --resume --bit 4 --lr 0.01

Accuracy

Model	Acc.(fp32)	Acc.(8 bit quantize)
MNISTNet	97.96%	97.57%
ResNet18	84.40%	84.23%

STBP is a way to train SNN with datasets by Backward propagation.

Related tags

Overview

Train SNN with STBP in fp32 and low bit(quantize)

Usage

Download via GitHub:

example to define SNN_layers like ANN_layers

Training Fp32 Model

Training Quantize Model

Accuracy

About STBP

Owner

Ling Zhang

Help you understand Manual and w/ Clutch point while driving.

QAT(quantize aware training) for classification with MQBench

Tensorflow implementation of the paper "HumanGPS: Geodesic PreServing Feature for Dense Human Correspondences", CVPR 2021.

MG-GCN: Scalable Multi-GPU GCN Training Framework

Danfeng Hong, Lianru Gao, Jing Yao, Bing Zhang, Antonio Plaza, Jocelyn Chanussot. Graph Convolutional Networks for Hyperspectral Image Classification, IEEE TGRS, 2021.

Smart edu-autobooking - Johnson @ DMI-UNICT study room self-booking system

Simulation-based performance analysis of server-less Blockchain-enabled Federated Learning

Bridging the Gap between Label- and Reference based Synthesis(ICCV 2021)

An intuitive library to extract features from time series

SuMa++: Efficient LiDAR-based Semantic SLAM (Chen et al IROS 2019)

Source code for the Paper: CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints}

This is the official Pytorch-version code of FlatGCN (Flattened Graph Convolutional Networks for Recommendation).

PyContinual (An Easy and Extendible Framework for Continual Learning)

Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation

Implementation of Pooling by Sliced-Wasserstein Embedding (NeurIPS 2021)

This is the solution for 2nd rank in Kaggle competition: Feedback Prize - Evaluating Student Writing.

Speckle-free Holography with Partially Coherent Light Sources and Camera-in-the-loop Calibration

Open CV - Convert a picture to look like a cartoon sketch in python

COCO Style Dataset Generator GUI

XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale