Random filter: the importance of architecture

(27th-September-2020)

Let the filter be random, learning only the uppermost layer fully-connected layer

The architecture is much more important than the learning algorithm • Optimal input where pooling layer units most react: - Theoretical explanation [Saxe + 10]