Full list of architectures (presets)

We list all implemented NF architectures and their respective class names below. Using these presets facilitates experimentation and modeling, however you can also modify each architecture and build new ones.

Autoregressive architectures

We provide the list of autoregressive architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all autoregressive architectures here.

Architecture

Reference

NICE

Dinh et al. NICE: Non-linear Independent Components Estimation (2015)

RealNVP

Dinh et al. Density estimation using Real NVP (2017)

Inverse RealNVP

Dinh et al. Density estimation using Real NVP (2017)

MAF

Papamakarios et al. Masked Autoregressive Flow for Density Estimation (2018)

IAF

Kingma et al. Improving Variational Inference with Inverse Autoregressive Flow (2017)

Coupling RQ-NSF

Durkan et al. Neural Spline Flows (2019)

Masked autoregressive RQ-NSF

Durkan et al. Neural Spline Flows (2019)

Inverse autoregressive RQ-NSF

Durkan et al. Neural Spline Flows (2019)

Coupling LR-NSF

Dolatabadi et al. Invertible Generative Modeling using Linear Rational Splines (2020)

Masked autoregressive LR-NSF

Dolatabadi et al. Invertible Generative Modeling using Linear Rational Splines (2020)

Inverse autoregressive LR-NSF

Dolatabadi et al. Invertible Generative Modeling using Linear Rational Splines (2020)

Coupling deep SF

Masked autoregressive deep SF

Inverse autoregressive deep SF

Coupling dense SF

Masked autoregressive dense SF

Inverse autoregressive dense SF

Coupling deep-dense SF

Masked autoregressive deep-dense SF

Inverse autoregressive deep-dense SF

Unconstrained monotonic neural network

Multiscale architectures

We provide the list of multiscale autoregressive architectures in the table below. These architectures are specifically made for image modeling, but can also be used for voxels or tensors with more dimensions. Click the architecture name to see the API and usage examples. Check the API for all multiscale architectures here.

Architecture

Reference

MultiscaleNICE

Dinh et al. NICE: Non-linear Independent Components Estimation (2015)

Multiscale RealNVP

Dinh et al. Density estimation using Real NVP (2017)

Multiscale RQ-NSF

Durkan et al. Neural Spline Flows (2019)

Multiscale LR-NSF

Dolatabadi et al. Invertible Generative Modeling using Linear Rational Splines (2020)

Multiscale deep SF

Multiscale dense SF

Multiscale deep-dense SF

Shift Glow

Affine Glow

RQS Glow

LRS Glow

Deep sigmoidal Glow

Dense sigmoidal Glow

Deep-dense sigmoidal Glow

Residual architectures

We provide the list of iterative residual architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all residual architectures here.

Architecture

Reference

Invertible ResNet

ResFlow

ProximalResFlow

We also list presets for some convolutional iterative residual architectures in the table below. These are suitable for image modeling.

Architecture

Reference

Convolutional invertible ResNet

Convolutional ResFlow

We finally list presets for residual architectures, based on the matrix determinant lemma. These support either forward or inverse transformation, but not both. This means they can be used for either sampling (and variational inference) or density estimation (and maximum likelihood fits), but not both at the same time.

Architecture

Reference

Planar flow

Radial flow

Sylvester flow

Continuous architectures

We provide the list of continuous architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all continuous architectures here.

Architecture

Reference

DDNF

FFJORD

RNODE

OT-Flow

We also list presets for convolutional continuous architectures in the table below. These are suitable for image modeling.

Architecture

Reference

Convolutional DDNF

Convolutional FFJORD

Convolutional RNODE