3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers

Last update: Dec 21, 2022

Related tags

Pytorch Utilities 3D-RETR

Overview

3D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformers (BMVC 2021)

Zai Shi, Zhao Meng, Yiran Xing, Yunpu Ma, Roger Wattenhofer

∗The first two authors contribute equally to this work

[BMVC (with presentation)] [Paper] [Supplementary]

Citation

@inproceedings{3d-retr,
  author    = {Zai Shi, Zhao Meng, Yiran Xing, Yunpu Ma, Roger Wattenhofer},
  title     = {3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers},
  booktitle = {BMVC},
  year      = {2021}
}

Create Environment

git clone [email protected]:FomalhautB/3D-RETR.git
cd 3D-RETR
conda env create -f config/environment.yaml
conda activate 3d-retr

Prepare Data

ShapeNet

Download the Rendered Images and Voxelization (32) and decompress them into $SHAPENET_IMAGE and $SHAPENET_VOXEL

Train

Here is an example of reproducing the result of the single view 3D-RETR-B on the ShapeNet dataset:

python train.py \
    --model image2voxel \
    --transformer_config config/3d-retr-b.yaml \
    --annot_path data/ShapeNet.json \
    --model_path $SHAPENET_VOX \
    --image_path $SHAPENET_IMAGES \
    --gpus 1 \
    --precision 16 \
    --deterministic \
    --train_batch_size 16 \
    --val_batch_size 16 \
    --num_workers 4 \
    --check_val_every_n_epoch 1 \
    --accumulate_grad_batches 1 \
    --view_num 1 \
    --sample_batch_num 0 \
    --loss_type dice \

3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers

Related tags

Overview

3D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformers (BMVC 2021)

Zai Shi, Zhao Meng, Yiran Xing, Yunpu Ma, Roger Wattenhofer

Citation

Create Environment

Prepare Data

ShapeNet

Train

Owner

Zai Shi

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers

A pure Python implementation of Compact Bilinear Pooling and Count Sketch for PyTorch.

Bunch of optimizer implementations in PyTorch

PyNIF3D is an open-source PyTorch-based library for research on neural implicit functions (NIF)-based 3D geometry representation.

Riemannian Adaptive Optimization Methods with pytorch optim

S3-plugin is a high performance PyTorch dataset library to efficiently access datasets stored in S3 buckets.

Learning Sparse Neural Networks through L0 regularization

Official implementations of EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis.

PyTorch implementations of normalizing flow and its variants.

Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.

PyTorch Extension Library of Optimized Scatter Operations

Pretrained ConvNets for pytorch: NASNet, ResNeXt, ResNet, InceptionV4, InceptionResnetV2, Xception, DPN, etc.

A tiny package to compare two neural networks in PyTorch

Tez is a super-simple and lightweight Trainer for PyTorch. It also comes with many utils that you can use to tackle over 90% of deep learning projects in PyTorch.

PyTorch Lightning Optical Flow models, scripts, and pretrained weights.

A PyTorch implementation of L-BFGS.

Pytorch bindings for Fortran

High-fidelity performance metrics for generative models in PyTorch

higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual training steps.

3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers

Related tags

Overview

3D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformers (BMVC 2021)

Zai Shi*, Zhao Meng*, Yiran Xing, Yunpu Ma, Roger Wattenhofer

Citation

Create Environment

Prepare Data

ShapeNet

Train

Owner

Zai Shi

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers

A pure Python implementation of Compact Bilinear Pooling and Count Sketch for PyTorch.

Bunch of optimizer implementations in PyTorch

PyNIF3D is an open-source PyTorch-based library for research on neural implicit functions (NIF)-based 3D geometry representation.

Riemannian Adaptive Optimization Methods with pytorch optim

S3-plugin is a high performance PyTorch dataset library to efficiently access datasets stored in S3 buckets.

Learning Sparse Neural Networks through L0 regularization

Official implementations of EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis.

PyTorch implementations of normalizing flow and its variants.

Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.

PyTorch Extension Library of Optimized Scatter Operations

Pretrained ConvNets for pytorch: NASNet, ResNeXt, ResNet, InceptionV4, InceptionResnetV2, Xception, DPN, etc.

A tiny package to compare two neural networks in PyTorch

Tez is a super-simple and lightweight Trainer for PyTorch. It also comes with many utils that you can use to tackle over 90% of deep learning projects in PyTorch.

PyTorch Lightning Optical Flow models, scripts, and pretrained weights.

A PyTorch implementation of L-BFGS.

Pytorch bindings for Fortran

High-fidelity performance metrics for generative models in PyTorch

higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual training steps.

Zai Shi, Zhao Meng, Yiran Xing, Yunpu Ma, Roger Wattenhofer