Full list of architectures (presets)
We list all implemented NF architectures and their respective class names below. Using these presets facilitates experimentation and modeling, however you can also modify each architecture and build new ones.
Autoregressive architectures
We provide the list of autoregressive architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all autoregressive architectures here.
Architecture |
Reference |
|---|---|
Dinh et al. NICE: Non-linear Independent Components Estimation (2015) |
|
Dinh et al. Density estimation using Real NVP (2017) |
|
Dinh et al. Density estimation using Real NVP (2017) |
|
Papamakarios et al. Masked Autoregressive Flow for Density Estimation (2018) |
|
Kingma et al. Improving Variational Inference with Inverse Autoregressive Flow (2017) |
|
Durkan et al. Neural Spline Flows (2019) |
|
Durkan et al. Neural Spline Flows (2019) |
|
Durkan et al. Neural Spline Flows (2019) |
|
Dolatabadi et al. Invertible Generative Modeling using Linear Rational Splines (2020) |
|
Dolatabadi et al. Invertible Generative Modeling using Linear Rational Splines (2020) |
|
Dolatabadi et al. Invertible Generative Modeling using Linear Rational Splines (2020) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Multiscale architectures
We provide the list of multiscale autoregressive architectures in the table below. These architectures are specifically made for image modeling, but can also be used for voxels or tensors with more dimensions. Click the architecture name to see the API and usage examples. Check the API for all multiscale architectures here.
Architecture |
Reference |
|---|---|
Dinh et al. NICE: Non-linear Independent Components Estimation (2015) |
|
Dinh et al. Density estimation using Real NVP (2017) |
|
Durkan et al. Neural Spline Flows (2019) |
|
Dolatabadi et al. Invertible Generative Modeling using Linear Rational Splines (2020) |
|
Residual architectures
We provide the list of iterative residual architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all residual architectures here.
Architecture |
Reference |
|---|---|
We also list presets for some convolutional iterative residual architectures in the table below. These are suitable for image modeling.
Architecture |
Reference |
|---|---|
|
|
|
We finally list presets for residual architectures, based on the matrix determinant lemma. These support either forward or inverse transformation, but not both. This means they can be used for either sampling (and variational inference) or density estimation (and maximum likelihood fits), but not both at the same time.
Architecture |
Reference |
|---|---|
Continuous architectures
We provide the list of continuous architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all continuous architectures here.
Architecture |
Reference |
|---|---|
|
|
|
|
|
|
|
We also list presets for convolutional continuous architectures in the table below. These are suitable for image modeling.
Architecture |
Reference |
|---|---|
|
|
|
|
|