PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Last update: Dec 18, 2022

Overview

octconv.pytorch

PyTorch implementation of Octave Convolution in Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution

ResNet-50/101 on ImageNet

Architecture	LR decay strategy	Parameters	GFLOPs	Top-1 / Top-5 Accuracy (%)
ResNet-50	step (90 epochs)	25.557M	4.089	76.010 / 92.834
ResNet-50	cosine (120 epochs)	25.557M	4.089	77.150 / 93.468
Oct-ResNet-50 (alpha=0.5)	cosine (120 epochs)	25.557M	2.367	77.640 / 93.662
ResNet-101	cosine (120 epochs)	44.549M	7.801	78.898 / 94.304
Oct-ResNet-101 (alpha=0.5)	cosine (120 epochs)	44.549M	3.991	78.794 / 94.330
ResNet-152	cosine (120 epochs)	60.193M	11.514	79.234 / 94.556
Oct-ResNet-152 (alpha=0.5)	cosine (120 epochs)	60.193M	5.615	79.258 / 94.480

MobileNet V1 on ImageNet

Architecture	LR decay strategy	Parameters	FLOPs	Top-1 / Top-5 Accuracy (%)
MobileNetV1	cosine (150 epochs)	4.232M	568.7M	72.238 / 90.536
Oct-MobileNetV1	cosine (150 epochs)	4.232M	318.2M	71.254 / 89.728

Acknowledgement

Official MXNet implmentation by @cypw

Citation

@InProceedings{Chen_2019_ICCV,
author = {Chen, Yunpeng and Fan, Haoqi and Xu, Bing and Yan, Zhicheng and Kalantidis, Yannis and Rohrbach, Marcus and Yan, Shuicheng and Feng, Jiashi},
title = {Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {October},
year = {2019}
}

PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Related tags

Overview

octconv.pytorch

ResNet-50/101 on ImageNet

MobileNet V1 on ImageNet

Acknowledgement

Citation

Owner

Duo Li

Repo for the paper "DiLBERT: Cheap Embeddings for Disease Related Medical NLP"

Activating More Pixels in Image Super-Resolution Transformer

These are the materials for the paper "Few-Shot Out-of-Domain Transfer Learning of Natural Language Explanations"

Semi-Supervised Signed Clustering Graph Neural Network (and Implementation of Some Spectral Methods)

Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification (NeurIPS 2021)

meProp: Sparsified Back Propagation for Accelerated Deep Learning (ICML 2017)

Deep Residual Learning for Image Recognition

TorchCV: A PyTorch-Based Framework for Deep Learning in Computer Vision

CompilerGym is a library of easy to use and performant reinforcement learning environments for compiler tasks

Hand-distance-measurement-game - Hand Distance Measurement Game

Optimized Gillespie algorithm for simulating Stochastic sPAtial models of Cancer Evolution (OG-SPACE)

GAN example for Keras. Cuz MNIST is too small and there should be something more realistic.

Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset (CVPR'19)

Video Swin Transformer - PyTorch

FinRL-Meta: A Universe for Data-Driven Financial Reinforcement Learning. 🔥

Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation

📖 Deep Attentional Guided Image Filtering

An implementation of the AlphaZero algorithm for Gomoku (also called Gobang or Five in a Row)

Code for Greedy Gradient Ensemble for Visual Question Answering （ICCV 2021, Oral）

ObsPy: A Python Toolbox for seismology/seismological observatories.

PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Related tags

Overview

octconv.pytorch

ResNet-50/101 on ImageNet

MobileNet V1 on ImageNet

Acknowledgement

Citation

Owner

Duo Li

Repo for the paper "DiLBERT: Cheap Embeddings for Disease Related Medical NLP"

Activating More Pixels in Image Super-Resolution Transformer

These are the materials for the paper "Few-Shot Out-of-Domain Transfer Learning of Natural Language Explanations"

Semi-Supervised Signed Clustering Graph Neural Network (and Implementation of Some Spectral Methods)

Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification (NeurIPS 2021)

meProp: Sparsified Back Propagation for Accelerated Deep Learning (ICML 2017)

Deep Residual Learning for Image Recognition

TorchCV: A PyTorch-Based Framework for Deep Learning in Computer Vision

CompilerGym is a library of easy to use and performant reinforcement learning environments for compiler tasks

Hand-distance-measurement-game - Hand Distance Measurement Game

Optimized Gillespie algorithm for simulating Stochastic sPAtial models of Cancer Evolution (OG-SPACE)

GAN example for Keras. Cuz MNIST is too small and there should be something more realistic.

Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset (CVPR'19)

Video Swin Transformer - PyTorch

FinRL­-Meta: A Universe for Data­-Driven Financial Reinforcement Learning. 🔥

Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation

📖 Deep Attentional Guided Image Filtering

An implementation of the AlphaZero algorithm for Gomoku (also called Gobang or Five in a Row)

Code for Greedy Gradient Ensemble for Visual Question Answering （ICCV 2021, Oral）

ObsPy: A Python Toolbox for seismology/seismological observatories.

FinRL-Meta: A Universe for Data-Driven Financial Reinforcement Learning. 🔥