QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Last update: Dec 31, 2022

Related tags

Overview

QueryDet-PyTorch

This repository is the official implementation of our paper: QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection

Requirement

a. Install Pytorch 1.4 following here

b. Install APEX following here

c. Install our Pytorch based sparse convolution operation following here

d. Install the detectron2 toolkit following here, note that we build our approach based on version 0.2.1. Note you may follow the instructions to set COCO configs

d. Clone our repository and have fun with it!

Usage

1. Data preparation

a. To prepare MS-COCO, you may follow the instructions of Detectron2

b. We provide the data preprocessing code for VisDrone2018. You need to first download dataset from here

c. Check visdrone/data_prepare.py to process the dataset

2. Training

% train coco RetinaNet baseline
python train_coco.py --config-file models/retinanet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train coco QueryDet 
python train_coco.py --config-file models/querydet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone RetinaNet baseline
python train_visdrone.py --config-file models/retinanet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone QueryDet
python train_visdrone.py --config-file models/querydet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

3. Test

% test coco RetinaNet baseline
python infer_coco.py --config-file models/retinanet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with Dense Inference
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with CSQ
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth MODEL.QUERY.QUERY_INFER True

QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Related tags

Overview

QueryDet-PyTorch

Requirement

Usage

1. Data preparation

2. Training

3. Test

Owner

Chenhongyi Yang

🧮 Matrix Factorization for Collaborative Filtering is just Solving an Adjoint Latent Dirichlet Allocation Model after All

Demonstration of transfer of knowledge and generalization with distillation

A transformer-based method for Healthcare Image Captioning in Vietnamese

Hummingbird compiles trained ML models into tensor computation for faster inference.

【steal piano】GitHub偷情分析工具！

Official Implementation for the "An Empirical Investigation of 3D Anomaly Detection and Segmentation" paper.

Tensorflow implementation of Character-Aware Neural Language Models.

a reimplementation of UnFlow in PyTorch that matches the official TensorFlow version

Multi-label classification of retinal disorders

This repository contains the source code for the paper Tutorial on amortized optimization for learning to optimize over continuous domains by Brandon Amos

Code repo for "Transformer on a Diet" paper

CLIP (Contrastive Language–Image Pre-training) for Italian

A simplistic and efficient pure-python neural network library from Phys Whiz with CPU and GPU support.

PyTorch-based framework for Deep Hedging

A repository for benchmarking neural vocoders by their quality and speed.

Code/data of the paper "Hand-Object Contact Prediction via Motion-Based Pseudo-Labeling and Guided Progressive Label Correction" (BMVC2021)

Implementation of RegretNet with Pytorch

Code for the SIGIR 2022 paper "Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completion"

Multitask Learning Strengthens Adversarial Robustness

Efficient 6-DoF Grasp Generation in Cluttered Scenes