A library for debugging/inspecting machine learning classifiers and explaining their predictions

Last update: Dec 30, 2022

Overview

ELI5

ELI5 is a Python package which helps to debug machine learning classifiers and explain their predictions.

It provides support for the following machine learning frameworks and packages:

scikit-learn. Currently ELI5 allows to explain weights and predictions of scikit-learn linear classifiers and regressors, print decision trees as text or as SVG, show feature importances and explain predictions of decision trees and tree-based ensembles. ELI5 understands text processing utilities from scikit-learn and can highlight text data accordingly. Pipeline and FeatureUnion are supported. It also allows to debug scikit-learn pipelines which contain HashingVectorizer, by undoing hashing.
Keras - explain predictions of image classifiers via Grad-CAM visualizations.
xgboost - show feature importances and explain predictions of XGBClassifier, XGBRegressor and xgboost.Booster.
LightGBM - show feature importances and explain predictions of LGBMClassifier and LGBMRegressor.
CatBoost - show feature importances of CatBoostClassifier, CatBoostRegressor and catboost.CatBoost.
lightning - explain weights and predictions of lightning classifiers and regressors.
sklearn-crfsuite. ELI5 allows to check weights of sklearn_crfsuite.CRF models.

ELI5 also implements several algorithms for inspecting black-box models (see Inspecting Black-Box Estimators):

TextExplainer allows to explain predictions of any text classifier using LIME algorithm (Ribeiro et al., 2016). There are utilities for using LIME with non-text data and arbitrary black-box classifiers as well, but this feature is currently experimental.
Permutation importance method can be used to compute feature importances for black box estimators.

Explanation and formatting are separated; you can get text-based explanation to display in console, HTML version embeddable in an IPython notebook or web dashboards, a pandas.DataFrame object if you want to process results further, or JSON version which allows to implement custom rendering and formatting on a client.

License is MIT.

Check docs for more.

A library for debugging/inspecting machine learning classifiers and explaining their predictions

Related tags

Overview

ELI5

Owner

Implementation of linear CorEx and temporal CorEx.

⬛ Python Individual Conditional Expectation Plot Toolbox

Visualizer for neural network, deep learning, and machine learning models

Quickly and easily create / train a custom DeepDream model

Using / reproducing ACD from the paper "Hierarchical interpretations for neural network predictions" 🧠 (ICLR 2019)

Algorithms for monitoring and explaining machine learning models

A Practical Debugging Tool for Training Deep Neural Networks

Many Class Activation Map methods implemented in Pytorch for CNNs and Vision Transformers. Including Grad-CAM, Grad-CAM++, Score-CAM, Ablation-CAM and XGrad-CAM

An intuitive library to add plotting functionality to scikit-learn objects.

Pytorch implementation of convolutional neural network visualization techniques

Lime: Explaining the predictions of any machine learning classifier

L2X - Code for replicating the experiments in the paper Learning to Explain: An Information-Theoretic Perspective on Model Interpretation.

An Empirical Review of Optimization Techniques for Quantum Variational Circuits

treeinterpreter - Interpreting scikit-learn's decision tree and random forest predictions.

tensorboard for pytorch (and chainer, mxnet, numpy, ...)

ModelChimp is an experiment tracker for Deep Learning and Machine Learning experiments.

JittorVis - Visual understanding of deep learning model.

Contrastive Explanation (Foil Trees), developed at TNO/Utrecht University

pytorch implementation of "Distilling a Neural Network Into a Soft Decision Tree"

Interactive convnet features visualization for Keras