PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10
python DDP_moco_ccrop.py configs/small/cifar10/moco_alpha0.1_th0.1.py

# SimSiam, CIFAR-100
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_alpha0.1_th0.1.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_alpha0.1_th0.1/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_alpha0.1_th0.1/last.pth

More models and datasets coming soon.

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

Preparation

Pre-train

Linear Evaluation

Owner

PyTorch source code for Distilling Knowledge by Mimicking Features

This library contains a Tensorflow implementation of the paper Stability Analysis of Unfolded WMMSE for Power Allocation

On Evaluation Metrics for Graph Generative Models

Dynamical movement primitives (DMPs), probabilistic movement primitives (ProMPs), spatially coupled bimanual DMPs.

Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning

Fast and robust certifiable relative pose estimation

Good Classification Measures and How to Find Them

[ICRA2021] Reconstructing Interactive 3D Scene by Panoptic Mapping and CAD Model Alignment

Generative Adversarial Text to Image Synthesis

LOFO (Leave One Feature Out) Importance calculates the importances of a set of features based on a metric of choice,

The Codebase for Causal Distillation for Language Models.

HiFi++: a Unified Framework for Neural Vocoding, Bandwidth Extension and Speech Enhancement

An off-line judger supporting distributed problem repositories

A Python package for generating concise, high-quality summaries of a probability distribution

Accommodating supervised learning algorithms for the historical prices of the world's favorite cryptocurrency and boosting it through LightGBM.

Code for approximate graph reduction techniques for cardinality-based DSFM, from paper

Implementation of the federated dual coordinate descent (FedDCD) method.

Cereal box identification in store shelves using computer vision and a single train image per model.

Multiview 3D object detection on MultiviewC dataset through moft3d.

Edge Restoration Quality Assessment