Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Open-L2O: A Comprehensive and Reproducible Benchmark for Learning to Optimize Algorithms

Its a Plant Leaf Disease Detection System based on Machine Learning.

This tool converts a Nondeterministic Finite Automata (NFA) into a Deterministic Finite Automata (DFA)

Implementation for the paper SMPLicit: Topology-aware Generative Model for Clothed People (CVPR 2021)

OMLT: Optimization and Machine Learning Toolkit

Establishing Strong Baselines for TripClick Health Retrieval; ECIR 2022

Deep Reinforced Attention Regression for Partial Sketch Based Image Retrieval.

Unofficial implementation of the Involution operation from CVPR 2021

A tensorflow model that predicts if the image is of a cat or of a dog.

Omnidirectional Scene Text Detection with Sequential-free Box Discretization (IJCAI 2019). Including competition model, online demo, etc.

Code for Talk-to-Edit (ICCV2021). Paper: Talk-to-Edit: Fine-Grained Facial Editing via Dialog.

Virtual Dance Reality Stage: a feature that offers you to share a stage with another user virtually

GNN4Traffic - This is the repository for the collection of Graph Neural Network for Traffic Forecasting

Ensemble Visual-Inertial Odometry (EnVIO)

Face Mask Detection on Image and Video using tensorflow and keras

Sound-guided Semantic Image Manipulation - Official Pytorch Code (CVPR 2022)

Official PyTorch implementation of "The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose Estimation" (ICCV 21).

A simple editor for captions in .SRT file extension

Dogs classification with Deep Metric Learning using some popular losses

Build tensorflow keras model pipelines in a single line of code. Created by Ram Seshadri. Collaborators welcome. Permission granted upon request.