Alibi Detect
  • Alibi Detect
  • Getting Started
  • Algorithm Overview
  • Saving and Loading
  • Detector Configuration Files
  • Roadmap
  • Outlier Detection
    • Methods
      • Mahalanobis Distance
      • Isolation Forest
      • Variational Auto-Encoder
      • Auto-Encoder
      • Variational Auto-Encoding Gaussian Mixture Model
      • Auto-Encoding Gaussian Mixture Model
      • Likelihood Ratios for Outlier Detection
      • Prophet Detector
      • Spectral Residual
      • Sequence-to-Sequence (Seq2Seq)
    • Examples
      • AE outlier detection on CIFAR10
      • AEGMM and VAEGMM outlier detection on KDD Cup ‘99 dataset
      • Isolation Forest outlier detection on KDD Cup ‘99 dataset
      • Likelihood Ratio Outlier Detection on Genomic Sequences
      • Likelihood Ratio Outlier Detection with PixelCNN++
      • Mahalanobis outlier detection on KDD Cup ‘99 dataset
      • Time-series outlier detection using Prophet on weather data
      • Seq2Seq time series outlier detection on ECG data
      • Time series outlier detection with Seq2Seq models on synthetic data
      • Time series outlier detection with Spectral Residuals on synthetic data
      • VAE outlier detection for income prediction
      • VAE outlier detection on CIFAR10
      • VAE outlier detection on KDD Cup ‘99 dataset
  • Drift Detection
    • Methods
      • Offline
        • Chi-Squared
        • Kolmogorov-Smirnov
        • Cramér-von Mises
        • Fisher’s Exact Test
        • Maximum Mean Discrepancy
        • Least-Squares Density Difference
        • Learned Kernel
        • Classifier
        • Spot-the-diff
        • Model Uncertainty
        • Mixed-type tabular data
        • Context-Aware Maximum Mean Discrepancy
      • Online
        • Online Maximum Mean Discrepancy
        • Online Least-Squares Density Difference
        • Online Cramér-von Mises
        • Online Fisher’s Exact Test
    • Examples
      • Categorical and mixed type data drift detection on income prediction
      • Learned drift detectors on Adult Census
      • Learned drift detectors on CIFAR-10
      • Context-aware drift detection on news articles
      • Context-aware drift detection on ECGs
      • Model Distillation drift detector on CIFAR-10
      • Kolmogorov-Smirnov data drift detector on CIFAR-10
      • Maximum Mean Discrepancy drift detector on CIFAR-10
      • Scaling up drift detection with KeOps
      • Model uncertainty based drift detection on CIFAR-10 and Wine-Quality datasets
      • Drift detection on molecular graphs
      • Online drift detection for Camelyon17 medical imaging dataset
      • Online Drift Detection on the Wine Quality Dataset
      • Interpretable drift detection with the spot-the-diff detector on MNIST and Wine-Quality datasets
      • Supervised drift detection on the penguins dataset
      • Drift detection on Amazon reviews
      • Text drift detection on IMDB movie reviews
  • Adversarial Detection
    • Methods
      • Adversarial Auto-Encoder
      • Model Distillation
    • Examples
      • Adversarial AE detection and correction on CIFAR-10
  • Deployment
  • Datasets
  • Models
  • Bibliography
Powered by GitBook
On this page

Was this helpful?

Edit on GitHub
Export as PDF

Alibi Detect

NextGetting Started

Last updated 28 days ago

Was this helpful?

Alibi Detect

Alibi Detect is a source-available Python library focused on outlier, adversarial and drift detection. The package aims to cover both online and offline detectors for tabular data, text, images and time series. Both TensorFlow and PyTorch backends are supported for drift detection.

For more background on the importance of monitoring outliers and distributions in a production setting, check out this talk from the Challenges in Deploying and Monitoring Machine Learning Systems ICML 2020 workshop, based on the paper Monitoring and explainability of models in production and referencing Alibi Detect.

For a thorough introduction to drift detection, check out the talk below titled, Protecting Your Machine Learning Against Drift: An Introduction. The talk covers what drift is and why it pays to detect it, the different types of drift, how it can be detected in a principled manner and also describes the anatomy of a drift detector.

Alibi Detect Logo