NADE

(20th-December-2020)

• The neural autoregressive density estimator (NADE) is a very successful recent form of neural auto-regressive network (Larochelle and Murray 2011 , ). The connectivity is the same as for the original neural auto-regressive network of Bengio and Bengio 2000b ( ) but NADE introduces an additional parameter sharing scheme, as illustrated in figure . The parameters of the hidden units of different groups 20.10 j are shared.