# Learning Gamelan

April 5, 2016 — August 5, 2022

**Attention conservation notice**: Crib notes for a 2 year long project which I ultimately abandoned in late 2018, about approximating convnet with recurrent neural networks for analysing time series. This project currently exists purely as LaTeX files on my hard drive, which need to be imported for future reference. I did learn some useful tricks along the way about controlling the poles of IIR filters for learning by gradient descent, and those will be actually interesting.

I feel a certain class of audio signal should be easy to decompose and thence learn in a musically useful way; ones approximated by LTI, nearly-linear, nearly-additive filterbanks with sparse activations. Mostly we handle musical signals via convnets which is not satisfying, and one feels one could do better with a more appropriate architecture. This project was about finding that architecture.

Some observations about theory is in recurrent/convolutional/state-space.

## 1 References

*arXiv:1902.01028 [Cs, Math, Stat]*.

*IEEE Transactions on Signal Processing*.

*Digital signal processing: signals, systems and filters*.

*Proceedings of the 33rd International Conference on International Conference on Machine Learning - Volume 48*. ICML’16.

*Numerical methods for evolutionary differential equations*. Computational science and engineering 5.

*IEEE Signal Processing Magazine*.

*Journal of Machine Learning Research*.

*arXiv:1306.2119 [Cs, Math, Stat]*.

*Journal of Signal Processing Systems*.

*arXiv:1404.7456 [Cs, Stat]*.

*Journal of Mathematical Imaging and Vision*.

*IEEE transactions on neural networks and learning systems*.

*IEEE Transactions on Neural Networks*.

*Advances in Neural Information Processing Systems 28*. NIPS’15.

*IEEE Transactions on Audio, Speech, and Language Processing*.

*The measurement of power spectra from the point of view of communications engineering*.

*Journal of the American Statistical Association*.

*International Conference on Machine Learning*.

*Journal of Machine Learning Research*.

*Computational Optimization of Systems Governed by Partial Differential Equations*. Computational Science and Engineering Series.

*29th International Conference on Machine Learning*.

*JSRU Report*.

*Proceedings of the 20th International Conference on Digital Audio Effects*.

*Neural Networks (IJCNN), 2016 International Joint Conference on*.

*IEEE Journal of Selected Topics in Signal Processing*.

*PRoceedings of ICLR*.

*arXiv:1709.03698 [Cs, Stat]*.

*IEEE Transactions on Signal Processing*.

*Journal of Economic Surveys*.

*arXiv:1709.04396 [Cs]*.

*PRoceedings of ISMIR*.

*2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)*.

*Proceeding of The 18th International Society of Music Information Retrieval (ISMIR) Conference 2017*.

*arXiv:1610.02357 [Cs]*.

*Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics*.

*arXiv:1609.01704 [Cs]*.

*NIPS*.

*Advances in Neural Information Processing Systems 28*.

*arXiv:1611.09913 [Cs, Stat]*.

*arXiv Preprint arXiv:1603.09025*.

*arXiv:1708.02840 [Cs]*.

*arXiv:1610.00087 [Cs]*.

*IEEE Transactions on Acoustics, Speech, and Signal Processing*.

*Proceedings of the 18th International Society for Music Information Retrieval Conference (ISMIR’2017), Suzhou, China*.

*2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)*.

*arXiv:1801.10395 [Stat]*.

*Journal of Machine Learning Research*.

*Positive trigonometric polynomials and signal processing applications*. Signals and communication technology.

*Time Series Analysis by State Space Methods*. Oxford Statistical Science Series 38.

*Journal of Time Series Analysis*.

*IEEE Transactions on Signal Processing*.

*Proceedings of the 18th International Society for Music Information Retrieval Conference (ISMIR’2017), Suzhou, China*.

*PMLR*.

*IEEE Control Systems*.

*Neural Computation*.

*arXiv:1606.08650 [Stat]*.

*arXiv:1609.09799 [Cs, Stat]*.

*arXiv:1901.01189 [Cs, Eess, Stat]*.

*Advances in Neural Information Processing Systems 29*.

*NeuroImage*.

*Neural Networks*.

*Proceedings of the 33rd International Conference on Machine Learning (ICML-16)*.

*arXiv:1512.05287 [Stat]*.

*Proceedings of ICASSP 2017*.

*Annals of Mathematics*.

*arXiv:1701.04489 [Cs, Stat]*.

*The American Mathematical Monthly*.

*arXiv:1412.6544 [Cs, Stat]*.

*IEEE Transactions on Signal Processing*.

*arXiv:1401.2224 [Cs]*.

*Supervised Sequence Labelling with Recurrent Neural Networks*. Studies in Computational Intelligence, v. 385.

*IEEE Transactions on Circuits and Systems*.

*Proceedings of the 27th International Conference on Machine Learning (ICML-10)*.

*arXiv:1105.5307 [Cs]*.

*Proc. Soc. Photographic Instrumentation Eng.*

*IEEE Transactions on Signal Processing*.

*Signal Processing*, Sparse Approximations in Signal and Image ProcessingSparse Approximations in Signal and Image Processing,.

*The Twenty-Third Conference on Uncertainty in Artificial Intelligence (UAI2007)*.

*Advances in Neural Information Processing Systems 29*.

*Advances in Neural Information Processing Systems*.

*Proceedings of ICLR*.

*Inverse Problems*.

*The Journal of Machine Learning Research*.

*Proceedings of the IEEE*.

*Kalman Filtering and Neural Networks*. Adaptive and Learning Systems for Signal Processing, Communications, and Control.

*Advances in Neural Information Processing Systems 28*.

*NIPS*.

*Signal Processing Conference, 2005 13th European*.

*Die Lehre von Den Tonempfindungen Als Physiologische Grundlage Für Die Theorie Der Musik*.

*ISMIR*.

*Stochastic Processes and Their Applications*.

*IEEE Signal Processing Magazine*.

*International Journal of Uncertainty Fuzziness and Knowledge Based Systems*.

*A Field Guide to Dynamical Recurrent Neural Networks*.

*Statistics Surveys*.

*Neural Networks*.

*Neural Networks*.

*Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on*.

*arXiv:1610.00195 [Physics, Stat]*.

*arXiv:1608.06993 [Cs]*.

*IEEE Transactions on Acoustics, Speech and Signal Processing*.

*IEEE Transactions on Signal Processing*.

*Sequential Monte Carlo Methods in Practice*. Statistics for Engineering and Information Science.

*arXiv:1511.05101 [Cs, Math, Stat]*.

*Neural Computation*.

*The Annals of Statistics*.

*Proceedings of the National Academy of Sciences*.

*Tutorial on Training Recurrent Neural Networks, Covering BPPT, RTRL, EKF and the” Echo State Network” Approach*.

*PMLR*.

*arXiv:1204.2477 [Cs, Stat]*.

*IEEE Transactions on Signal Processing*.

*2006 IEEE International Conference on Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings*.

*Proceedings of the 32nd International Conference on Machine Learning (ICML-15)*.

*Advances in Neural Information Processing Systems 29*.

*Linear Systems*. Prentice-Hall Information and System Science Series.

*IFAC Proceedings Volumes*, 15th IFAC Symposium on System Identification,.

*arXiv:1506.02078 [Cs]*.

*Advances in Neural Information Processing Systems*.

*IEEE Transactions on Information Theory*.

*Advances in Neural Information Processing Systems 29*.

*2010 IEEE International Conference on Acoustics, Speech and Signal Processing*.

*Advances in Neural Information Processing Systems 27*.

*Advances in Neural Information Processing Systems*.

*Proceedings of ICASSP 2017*.

*Neural Computation*.

*Physical Review. X*.

*arXiv Preprint arXiv:1511.05121*.

*Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence*.

*Advances in Neural Information Processing Systems*.

*Organised Sound*.

*Workshop on Proceedings of MOSART Current Research Directions in Computer Music Workshop*.

*Proceedings of International Conference on Learning Representations (ICLR) 2017*.

*arXiv:1707.02530 [Cs]*.

*arXiv Preprint arXiv:1508.06818*.

*BMC Neuroscience*.

*Advances In Neural Information Processing Systems*.

*ICASSP*.

*arXiv:1612.06212 [Cs]*.

*Proceedings of the 26th Annual International Conference on Machine Learning*. ICML ’09.

*arXiv:1703.01789 [Cs]*.

*42nd International Conference on Acoustics, Speech and Signal Processing (ICASSP)*. Proc. 42nd International Conference on Acoustics, Speech and Signal Processing (ICASSP).

*arXiv:1709.02755 [Cs]*.

*Nature Neuroscience*.

*NIPS*.

*Neural Computation*.

*arXiv:1803.04831 [Cs]*.

*IFAC-PapersOnLine (System Identification, Volume 16)*. 16th IFAC Symposium on System Identification.

*arXiv:1506.00019 [Cs]*.

*arXiv:1608.07373 [Cs]*.

*Sequential Monte Carlo Methods in Practice*. Statistics for Engineering and Information Science.

*IJCAI*.

*IEEE Transactions on Automatic Control*.

*System Identification: Theory for the User*. Prentice Hall Information and System Sciences Series.

*Stochastic Approximation and Optimization of Random Systems*.

*IEEE Transactions on Signal Processing*.

*IEEE Transactions on Signal Processing*.

*Proceedings of the 28th International Conference on International Conference on Machine Learning*. ICML’11.

*Neural Networks: Tricks of the Trade*. Lecture Notes in Computer Science.

*Organised Sound*.

*Organised Sound*.

*IEEE Signal Processing Magazine*.

*IEEE Conference on Computer Vision and Pattern Recognition (CVPR)*.

*42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475)*.

*Proceedings of International Conference on Learning Representations (ICLR) 2017*.

*The Annals of Statistics*.

*Pattern Recognition and Artificial Intelligence,*.

*Proceedings of International Conference on Learning Representations (ICLR) 2017*.

*PMLR*.

*arXiv:1701.07138 [Cs, q-Bio]*.

*The Annals of Probability*.

*Neural Networks*.

*IEEE Transactions on Acoustics, Speech and Signal Processing*.

*Advances in Water Resources*.

*arXiv:1805.08394 [Cs]*.

*Proc. Int. Conf. Music Info. Retrieval*.

*IEEE Workshop on Applications of Signal Processing to Audio and Acoustics*.

*Science*.

*arXiv:0803.2392 [Cs, Math]*.

*Neural Computation*.

*Perspectives in Robust Control*. Lecture Notes in Control and Information Sciences.

*arXiv:1211.5063 [Cs]*.

*arXiv:1612.09158 [Cs, Stat]*.

*2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI)*.

*arXiv:1805.00237 [Cs, Eess]*.

*Journal of the Audio Engineering Society*.

*arXiv:1611.09526 [Cs]*.

*arXiv:1611.09524 [Cs]*.

*IEEE Signal Processing Magazine*.

*Transactions of the American Institute of Electrical Engineers, Part II: Applications and Industry*.

*International Journal of Speech Technology*.

*Automatic Differentiation: Techniques and Applications*. Lecture Notes in Computer Science 120.

*Int. Conf. Music Info. Retrieval*.

*Neural Computation*.

*IEEE Signal Processing Letters*.

*IEEE Signal Processing Letters*.

*The Annals of Mathematical Statistics*.

*NIPS Workshop on Machine Learning for Creativity and Design*.

*Proceedings of the 7th International Conference on New Interfaces for Musical Expression*. NIME ’07.

*Proceedings of European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases*.

*Proceedings of the International Computer Music Conference 2011*.

*IEEE Transactions on Signal Processing*.

*Proceedings of the IEEE*.

*2013 IEEE Workshop on Automatic Speech Recognition and Understanding*.

*Submitted to Proc. Interspeech*.

*INTERSPEECH*.

*Journal of Machine Learning Research*.

*2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton)*.

*2015 American Control Conference (ACC)*.

*Automatica*.

*arXiv:1804.09288 [Cs, Eess]*.

*Automatica*, Trends in System Identification,.

*Independent Component Analysis and Blind Signal Separation*. Lecture Notes in Computer Science.

*Applications of Signal Processing to Audio and Acoustics, 2003 IEEE Workshop on.*

*The Scientist and Engineer’s Guide to Digital Signal Processing*.

*Introduction to Digital Filters with Audio Applications*.

*Advances in Neural Information Processing Systems*.

*Nature*.

*arXiv:1702.04283 [Cs]*.

*System Identification*.

*arXiv:1701.01207 [Cs, Math, Stat]*.

*arXiv:1805.04955 [Cs, Stat]*.

*ICML (3)*.

*Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition*.

*PMLR*.

*Proceedings of International Conference on Learning Representations (ICLR) 2017*.

*Neural Networks*.

*ICLR*.

*IEEE Transactions on Audio, Speech, and Language Processing*.

*Proceedings of the IEEE International Conference Acoustics, Speech, and Signal Processing*.

*Multimedia Tools and Applications*.

*Proceedings of the IEEE*.

*Neurocomputing*, Evolving Solution with Neural Networks,.

*9th ISCA Speech Synthesis Workshop*.

*arXiv:1705.02514 [Cs]*.

*arXiv:1709.07908 [Cs, Eess]*.

*2008 IEEE International Conference on Acoustics, Speech and Signal Processing*.

*Signal Processing Methods for Music Transcription*.

*IEEE Transactions on Audio, Speech, and Language Processing*.

*arXiv:1804.10204 [Cs, Eess, Stat]*.

*Proceedings of the 22Nd ACM International Conference on Multimedia*. MM ’14.

*IEEE Transactions on Audio and Electroacoustics*.

*Neural Networks*.

*Proceedings of the IEEE*.

*IEEE Transactions on Information Theory*.

*Neural Computation*.

*Neural Computation*.

*Advances in Neural Information Processing Systems*.

*Advances in Neural Information Processing Systems 29*.

*Organised Sound*.

*Advances in Neural Information Processing Systems 29*.

*Proceedings of the First International Conference on Deep Learning and Music, Anchorage, US, May, 2017 (arXiv:1706.08675v1 [Cs.NE])*.

*IEEE Transactions on Signal Processing*.

*SIAM Journal on Imaging Sciences*.

*IEEE Signal Processing Magazine*.

*arXiv:1804.09298 [Cs, Eess]*.

*Acoustics, Speech, and Signal Processing, IEEE International Conference on*.

*Proceedings of International Conference on Learning Representations (ICLR) 2017*.

*arXiv:1609.01000 [Cs]*.

*International Conference on Multimedia and Ubiquitous Engineering, 2007. MUE ’07*.

*Interspeech 2016*.

*Proceedings of DAFx-01*.

*Proceedings of the Twentieth International Conference on International Conference on Machine Learning*. ICML’03.