MLP-Mixer neural networks

2021-11-20 — 2023-03-30

machine learning
neural nets
signal processing
Figure 1

Position encoding plus clever MLPs; an alternative to convolutional_networks

1 References

Tolstikhin, Houlsby, Kolesnikov, et al. 2021. MLP-Mixer: An All-MLP Architecture for Vision.” In Advances in Neural Information Processing Systems.
Touvron, Bojanowski, Caron, et al. 2022. ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training.” IEEE Transactions on Pattern Analysis and Machine Intelligence.