Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Last update: Dec 12, 2022

Related tags

Deep Learning SODEF

Overview

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackss.

Qiyu Kang, Yang Song, Qinxu Ding, Wee Peng Tay

Environment settings

OS: Ubuntu 18.04
GPU: RTX 2080 Ti, RTX a5000, RTX 3090
Cuda: 11.1 or 10.2
Python: >=3.6
PyTorch: >= 1.6.0
Torchvision: >= 0.7.0

Empirical Evaluations

Compatibility of SODEF

In this section, we show compatibility of SODEF using TRADES:

We append our SODEF after TRADES net to improve the model robustness against adversarial attacks. TRADES works as the feature extractor $h_{\boldsymbol{\phi}}$ as in our paper. Please note TRADES weights are kept fixed during the training. We use the pretrained model provided by TRADES Repo.

Attack / Model	TRADES ℒ_∞	TRADES+SODEF ℒ_∞	TRADES ℒ₂	TRADES+SODEF ℒ₂
Clean	85.48	85.18	85.48	85.18
APGD_CE	56.08	70.90	61.74	74.35
APGD_DLR^T	53.70	64.15	59.22	68.55
FAB^T	54.18	82.92	60.31	83.15
Square	59.12	62.21	72.65	76.02
AutoAttack	53.69	57.76	59.42	67.75

Tab 1. Classification accuracy (%) using TRADES (w/ and w/o SODEF) under AutoAttack on adversarial CIFAR10 examples with ℒ₂ norm (ϵ = 0.5) and ℒ_∞ norm (ϵ = 8/255).

Transfer attack:

Classification accuracy for adv examples generated from original pretrained model using AA ℒ_∞ (ϵ = 8/255) attacks : 61.94%.

cd trades_r
python sodef_eval_ode.py

cd trades_r
sodef_eval_transfer.ipynb

Notification

More test code and models will be uploaded soon after packing.

We currenly only upload the test code for SODEF. Please understand we have strict protocols for code release as this research is partially funded by corporate funding. We will upload the training code as soon as permission is granted.

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Related tags

Overview

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Environment settings

Empirical Evaluations

Compatibility of SODEF

In this section, we show compatibility of SODEF using TRADES:

Notification

Owner

Kang Qiyu

PIXIE: Collaborative Regression of Expressive Bodies

FAST Aiming at the problems of cumbersome steps and slow download speed of GNSS data

The source code for Adaptive Kernel Graph Neural Network at AAAI2022

The object detection pipeline is based on Ultralytics YOLOv5

Geometric Vector Perceptrons --- a rotation-equivariant GNN for learning from biomolecular structure

Post-Training Quantization for Vision transformers.

Gesture Volume Control Using OpenCV and MediaPipe

[NeurIPS-2021] Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data

FACIAL: Synthesizing Dynamic Talking Face With Implicit Attribute Learning. ICCV, 2021.

Solution to the first stage Quiz of Hamoye internship: Introduction to Python for Machine Learning

Revisiting Video Saliency: A Large-scale Benchmark and a New Model (CVPR18, PAMI19)

🥇Samsung AI Challenge 2021 1등 솔루션입니다🥇

一套完整的微博舆情分析流程代码，包括微博爬虫、LDA主题分析和情感分析。

Discord bot for notifying on github events

Simulated garment dataset for virtual try-on

PyTorch code for the "Deep Neural Networks with Box Convolutions" paper

Easy and comprehensive assessment of predictive power, with support for neuroimaging features

Semantic-aware Grad-GAN for Virtual-to-Real Urban Scene Adaption

Code for our ALiBi method for transformer language models.

CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiability