MLP-Mixer neural networks
2021-11-20 — 2023-03-30
Wherein Position Encoding Is Employed and Interleaved Token- And Channel-Wise Multilayer Perceptrons Are Used, and Image Structure Is Handled Without Convolutional Kernels, Is Expounded.
machine learning
neural nets
signal processing
Position encoding plus clever MLPs; an alternative to convolutional_networks
1 References
Tolstikhin, Houlsby, Kolesnikov, et al. 2021. “MLP-Mixer: An All-MLP Architecture for Vision.” In Advances in Neural Information Processing Systems.
Touvron, Bojanowski, Caron, et al. 2022. “ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training.” IEEE Transactions on Pattern Analysis and Machine Intelligence.