# Convolutional neural networks

November 10, 2017 — November 21, 2021

The network topology that more or less kicked off the current revolution in computer vision and thus the whole modern neural network craze.

Convolutional nets (*convnets* or *CNNs* to the suave) are well described elsewhere. I’m going to collect some choice morsels here. Classic signal processing baked in to neural networks.

There is a long story about how convolutions naturally encourage certain invariances and symmetries, although AFAICT it’s all somewhat hand-wavey.

Generally uses FIR filters plus some smudgy “pooling”.

## 1 Visualising

Here is a visualisations of convolutions: vdumoulin/conv_arithmetic

Visualising the actual activations of a convnet is an interesting data visualisation challenge, since intermediate activations often end up being high-rank tensors, but they have a lot of regularity that can be exploited to it feels like it should be feasible.

## 2 Connection to filter theory

TBC. For now work it out from other signal processing link material.

## 3 Resnets

Interesting, and they pop up in fun places like Dynamical models of neural nets. TBD.

## 4 References

*Advances In Neural Information Processing Systems*.

*IEEE Signal Processing Magazine*.

*Advances in Neural Information Processing Systems*.

*arXiv:1609.02907 [Cs, Stat]*.

*Advances in Neural Information Processing Systems*.

*arXiv:1503.03167 [Cs]*.

*Nature*.

*Proceedings of the 26th Annual International Conference on Machine Learning*. ICML ’09.

*Neural Processing Letters*.

*arXiv:1601.04920 [Cs, Stat]*.

*ICASSP*.

*arXiv:1412.6621 [Cs, Stat]*.

*Neural Computation*.

*Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015*. Lecture Notes in Computer Science.

*IEEE Transactions on Pattern Analysis and Machine Intelligence*.

*Proceedings of International Conference on Learning Representations (ICLR) 2015*.

*arXiv:1603.05691 [Cs, Stat]*.

*IEEE transactions on pattern analysis and machine intelligence*.

*Proceedings of IEEE International Symposium on Information Theory*.

*IEEE Transactions on Information Theory*.