Omnidirectional camera calibration in python

Last update: Nov 22, 2022

Related tags

Deep Learning py-omnicalib

Overview

Omnidirectional Camera Calibration

Key features

pure python
initial solution based on A Toolbox for Easily Calibrating Omnidirectional Cameras (Davide Scaramuzza, Agostino Martinelli, Roland Siegwart)
Optimized solution via Levenberg–Marquardt algorithm on reprojection error
Lie algebra based extrinsics optimization

(undistort example)

Usage

Corner detection (see python -m omnicalib.detect --help for detailed argument description)

python -m omnical.detect --chessboard <rows> <columns> <square-size> --max-dim <max-dim> --threads <threads> <image-folder>

The file detections.pickle is written, which contains a pickled dictionary with the following format

{
    'detections': {
        <image_path_0>: {'image_points': <image_points>, 'object_points': <object_points>},
        ...
}

Image paths (pathlib.Path) are absolute
image_points are torch.Tensor with shape N x 2 and dtype torch.float64
object_points are torch.Tensor with shape N x 3 and dtype torch.float64 and third colum, the z coordinate, all zeros

If an external corner detection method is used, this file can simply be written manually.

Calibration (see python -m omnicalib --help for detailed argument description)

python -m omnical --degree <degree> detections.pickle

Result

A calibration.yml file (see example_calibration.yml) containing

extrinsics as list of 3 x 4 matrices
poly_incident_angle_to_radius, a polynom that converts incident angle to image radius
poly_radius_to_z, a polynom that converts radius to z component of view vector
principal_point in pixel

Method

For a detailed description see method.md.

Simulation

Play with the calibration on simulated data with the provided jupyter lab notebook. It generates randomized data for the following ideal projection models

equidistant
stereographic
orthographic
equisolid

, see Large Area 3D Human Pose Detection Via Stereo Reconstruction in Panoramic Cameras for a detailed description.

Example

Jupyter lab notebook, example results

You might also like...

Improving Calibration for Long-Tailed Recognition (CVPR2021)

19 Apr 28, 2021

Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

SNN_Calibration Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021 Feature Comparison of SNN calibration: Features SNN Direct Tr

60 Dec 27, 2022

S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)

S2-BNN (Self-supervised Binary Neural Networks Using Distillation Loss) This is the official pytorch implementation of our paper: "S2-BNN: Bridging th

52 Dec 24, 2022

[CVPR 2022] Official code for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration"

MDCA Calibration This is the official PyTorch implementation for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved

21 Dec 22, 2022

Omnidirectional camera calibration in python

Related tags

Overview

Omnidirectional Camera Calibration

Key features

Usage

Result

Method

Simulation

Example

You might also like...

Improving Calibration for Long-Tailed Recognition (CVPR2021)

Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)

the code for paper "Energy-Based Open-World Uncertainty Modeling for Confidence Calibration"

We utilize deep reinforcement learning to obtain favorable trajectories for visual-inertial system calibration.

Improving Calibration for Long-Tailed Recognition (CVPR2021)

Source code of NeurIPS 2021 Paper ''Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration''

CSAC - Collaborative Semantic Aggregation and Calibration for Separated Domain Generalization

[CVPR 2022] Official code for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration"

Releases(1.0.1)

1.0.1(Mar 1, 2022)

1.0.0(Dec 21, 2021)

Owner

Thomas Pönitz

The backbone CSPDarkNet of YOLOX.

Official Pytorch Implementation of 3DV2021 paper: SAFA: Structure Aware Face Animation.

Official Matlab Implementation for "Tiny Obstacle Discovery by Occlusion-aware Multilayer Regression", TIP 2020

Complete U-net Implementation with keras

Occlusion robust 3D face reconstruction model in CFR-GAN (WACV 2022)

DetCo: Unsupervised Contrastive Learning for Object Detection

Anomaly Detection Based on Hierarchical Clustering of Mobile Robot Data

An integration of several popular automatic augmentation methods, including OHL (Online Hyper-Parameter Learning for Auto-Augmentation Strategy) and AWS (Improving Auto Augment via Augmentation Wise Weight Sharing) by Sensetime Research.

Source code for "Interactive All-Hex Meshing via Cuboid Decomposition [SIGGRAPH Asia 2021]".

for taichi voxel-challange event

Task Transformer Network for Joint MRI Reconstruction and Super-Resolution (MICCAI 2021)

NLU Dataset Diagnostics

For holding anime-related object classification and detection models

This toolkit provides codes to download and pre-process the SLUE datasets, train the baseline models, and evaluate SLUE tasks.

Controlling a game using mediapipe hand tracking

🐦 Quickly annotate data from the comfort of your Jupyter notebook

CompilerGym is a library of easy to use and performant reinforcement learning environments for compiler tasks

Machine Learning Privacy Meter: A tool to quantify the privacy risks of machine learning models with respect to inference attacks, notably membership inference attacks

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

JORLDY an open-source Reinforcement Learning (RL) framework provided by KakaoEnterprise