Full list of architectures (presets) ===================================================== We list all implemented NF architectures and their respective class names below. Using these presets facilitates experimentation and modeling, however you can also modify each architecture and build new ones. .. _autoregressive_architecture_list: Autoregressive architectures ----------------------------- We provide the list of autoregressive architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all autoregressive architectures :ref:`here `. .. list-table:: :header-rows: 1 * - Architecture - Reference * - :class:`NICE ` - Dinh et al. `NICE: Non-linear Independent Components Estimation `_ (2015) * - :class:`RealNVP ` - Dinh et al. `Density estimation using Real NVP `_ (2017) * - :class:`Inverse RealNVP ` - Dinh et al. `Density estimation using Real NVP `_ (2017) * - :class:`MAF ` - Papamakarios et al. `Masked Autoregressive Flow for Density Estimation `_ (2018) * - :class:`IAF ` - Kingma et al. `Improving Variational Inference with Inverse Autoregressive Flow `_ (2017) * - :class:`Coupling RQ-NSF ` - Durkan et al. `Neural Spline Flows `_ (2019) * - :class:`Masked autoregressive RQ-NSF ` - Durkan et al. `Neural Spline Flows `_ (2019) * - :class:`Inverse autoregressive RQ-NSF ` - Durkan et al. `Neural Spline Flows `_ (2019) * - :class:`Coupling LR-NSF ` - Dolatabadi et al. `Invertible Generative Modeling using Linear Rational Splines `_ (2020) * - :class:`Masked autoregressive LR-NSF ` - Dolatabadi et al. `Invertible Generative Modeling using Linear Rational Splines `_ (2020) * - :class:`Inverse autoregressive LR-NSF ` - Dolatabadi et al. `Invertible Generative Modeling using Linear Rational Splines `_ (2020) * - :class:`Coupling deep SF ` - * - :class:`Masked autoregressive deep SF ` - * - :class:`Inverse autoregressive deep SF ` - * - :class:`Coupling dense SF ` - * - :class:`Masked autoregressive dense SF ` - * - :class:`Inverse autoregressive dense SF ` - * - :class:`Coupling deep-dense SF ` - * - :class:`Masked autoregressive deep-dense SF ` - * - :class:`Inverse autoregressive deep-dense SF ` - * - :class:`Unconstrained monotonic neural network ` - .. _multiscale_architecture_list: Multiscale architectures ----------------------------------------- We provide the list of multiscale autoregressive architectures in the table below. These architectures are specifically made for image modeling, but can also be used for voxels or tensors with more dimensions. Click the architecture name to see the API and usage examples. Check the API for all multiscale architectures :ref:`here `. .. list-table:: :header-rows: 1 * - Architecture - Reference * - :class:`MultiscaleNICE ` - Dinh et al. `NICE: Non-linear Independent Components Estimation `_ (2015) * - :class:`Multiscale RealNVP ` - Dinh et al. `Density estimation using Real NVP `_ (2017) * - :class:`Multiscale RQ-NSF ` - Durkan et al. `Neural Spline Flows `_ (2019) * - :class:`Multiscale LR-NSF ` - Dolatabadi et al. `Invertible Generative Modeling using Linear Rational Splines `_ (2020) * - :class:`Multiscale deep SF ` - * - :class:`Multiscale dense SF ` - * - :class:`Multiscale deep-dense SF ` - * - :class:`Shift Glow ` - * - :class:`Affine Glow ` - * - :class:`RQS Glow ` - * - :class:`LRS Glow ` - * - :class:`Deep sigmoidal Glow ` - * - :class:`Dense sigmoidal Glow ` - * - :class:`Deep-dense sigmoidal Glow ` - Residual architectures ---------------------------- We provide the list of iterative residual architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all residual architectures :ref:`here `. .. list-table:: :header-rows: 1 * - Architecture - Reference * - :class:`Invertible ResNet ` - * - :class:`ResFlow ` - * - :class:`ProximalResFlow ` - We also list presets for some convolutional iterative residual architectures in the table below. These are suitable for image modeling. .. list-table:: :header-rows: 1 * - Architecture - Reference * - :class:`Convolutional invertible ResNet ` - * - :class:`Convolutional ResFlow ` - We finally list presets for residual architectures, based on the matrix determinant lemma. These support either forward or inverse transformation, but not both. This means they can be used for either sampling (and variational inference) or density estimation (and maximum likelihood fits), but not both at the same time. .. list-table:: :header-rows: 1 * - Architecture - Reference * - :class:`Planar flow ` - * - :class:`Radial flow ` - * - :class:`Sylvester flow ` - Continuous architectures ---------------------------- We provide the list of continuous architectures in the table below. Click the architecture name to see the API and usage examples. Check the API for all continuous architectures :ref:`here `. .. list-table:: :header-rows: 1 * - Architecture - Reference * - :class:`DDNF ` - * - :class:`FFJORD ` - * - :class:`RNODE ` - * - :class:`OT-Flow ` - We also list presets for convolutional continuous architectures in the table below. These are suitable for image modeling. .. list-table:: :header-rows: 1 * - Architecture - Reference * - :class:`Convolutional DDNF ` - * - :class:`Convolutional FFJORD ` - * - :class:`Convolutional RNODE ` -