Aharon, M., M. Elad, and A. Bruckstein. 2006. “K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation.” IEEE Transactions on Signal Processing
54 (11): 4311–22.
Arora, Sanjeev, Rong Ge, Tengyu Ma, and Ankur Moitra. 2015. “Simple, Efficient, and Neural Algorithms for Sparse Coding.”
In Proceedings of The 28th Conference on Learning Theory
, 40:113–49. Paris, France: PMLR.
Bach, Francis R., and Michael I. Jordan. 2006. “Learning Spectral Clustering, with Application to Speech Separation.” Journal of Machine Learning Research
7 (Oct): 1963–2001.
Baraniuk, Richard G., Volkan Cevher, Marco F. Duarte, and Chinmay Hegde. 2010. “Model-Based Compressive Sensing.” IEEE Transactions on Information Theory
56 (4): 1982–2001.
Barron, Andrew R., Albert Cohen, Wolfgang Dahmen, and Ronald A. DeVore. 2008. “Approximation and Learning by Greedy Algorithms.” The Annals of Statistics
36 (1): 64–94.
Barthélemy, Quentin, Anthony Larue, Aurélien Mayoue, David Mercier, and Jérôme I. Mars. 2012. “Shift & 2D Rotation Invariant Sparse Coding for Multivariate Signals.” IEEE Transactions on Signal Processing
60 (4): 1597–1611.
Bertin, K., E. Le Pennec, and V. Rivoirard. 2011. “Adaptive Dantzig Density Estimation.” Annales de l’Institut Henri Poincaré, Probabilités Et Statistiques
47 (1): 43–74.
Beylkin, G., R. Coifman, and V. Rokhlin. 1991. “Fast Wavelet Transforms and Numerical Algorithms I.” Communications on Pure and Applied Mathematics
44 (2): 141–83.
Blumensath, Thomas, and Mike Davies. 2004. “On Shift-Invariant Sparse Coding.”
In Independent Component Analysis and Blind Signal Separation
, edited by Carlos G. Puntonet and Alberto Prieto, 3195:1205–12. Berlin, Heidelberg: Springer Berlin Heidelberg.
———. 2006. “Sparse and Shift-Invariant Representations of Music.” IEEE Transactions on Audio, Speech and Language Processing
14 (1): 50–57.
Bora, Ashish, Ajil Jalal, Eric Price, and Alexandros G. Dimakis. 2017. “Compressed Sensing Using Generative Models.”
In International Conference on Machine Learning
Bruna, Joan, and Stephane Mallat. 2013. “Invariant Scattering Convolution Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence
35 (8): 1872–86.
———. 2019. “Multiscale Sparse Microcanonical Models.” arXiv:1801.02013 [Math-Ph, Stat]
Bruna, Joan, Stéphane Mallat, Emmanuel Bacry, and Jean-François Muzy. 2015. “Intermittent Process Analysis with Scattering Moments.” The Annals of Statistics
43 (1): 323–51.
Cai, Jian-Feng, Raymond H. Chan, and Zuowei Shen. 2008. “A Framelet-Based Image Inpainting Algorithm.” Applied and Computational Harmonic Analysis
, Special Issue on Mathematical Imaging – Part II, 24 (2): 131–49.
Carabias-Orti, J. J., T. Virtanen, P. Vera-Candeas, N. Ruiz-Reyes, and F. J. Canadas-Quesada. 2011. “Musical Instrument Sound Multi-Excitation Model for Non-Negative Spectrogram Factorization.” IEEE Journal of Selected Topics in Signal Processing
5 (6): 1144–58.
Casazza, Peter G., and Richard G. Lynch. 2015. “A Brief Introduction to Hilbert Space Frame Theory and Its Applications.”
In Finite Frame Theory: A Complete Introduction to Overcompleteness
Chen, Shaobing, and David L. Donoho. 1994. “Basis Pursuit.”
In 1994 Conference Record of the Twenty-Eighth Asilomar Conference on Signals, Systems and Computers, 1994
, 1:41–44 vol.1.
Cheng, Sihao, and Brice Ménard. 2021. “How to Quantify Fields or Textures? A Guide to the Scattering Transform.” arXiv:2112.01288 [Astro-Ph, Physics:physics]
Cox, Christopher R., and Timothy T. Rogers. 2021. “Finding Distributed Needles in Neural Haystacks.” Journal of Neuroscience
41 (5): 1019–32.
Daubechies, I., M. Defrise, and C. De Mol. 2004. “An Iterative Thresholding Algorithm for Linear Inverse Problems with a Sparsity Constraint.” Communications on Pure and Applied Mathematics
57 (11): 1413–57.
Daubechies, Ingrid. 1988. “Orthonormal Bases of Compactly Supported Wavelets.” Communications on Pure and Applied Mathematics
41 (7): 909–96.
Daubechies, Ingrid, Bin Han, Amos Ron, and Zuowei Shen. 2003. “Framelets: MRA-Based Constructions of Wavelet Frames.” Applied and Computational Harmonic Analysis
14 (1): 1–46.
Davis, Geoffrey M. 1998. “A Wavelet-Based Analysis of Fractal Image Compression.” IEEE Transactions on Image Processing
7 (2): 141–54.
Davis, Geoffrey M., Stephane G. Mallat, and Zhifeng Zhang. 1994a. “Adaptive Time-Frequency Decompositions.” Optical Engineering
33 (7): 2183–91.
———. 1994b. “Adaptive Time-Frequency Decompositions with Matching Pursuit.”
In Wavelet Applications
, 2242:402–14. International Society for Optics and Photonics.
Davis, G., S. Mallat, and M. Avellaneda. 1997. “Adaptive Greedy Approximations.” Constructive Approximation
13 (1): 57–98.
DeVore, Ronald A. 1998. “Nonlinear Approximation.” Acta Numerica
7 (January): 51–150.
Donoho, David L., and Iain M. Johnstone. 1995. “Adapting to Unknown Smoothness via Wavelet Shrinkage.” Journal of the American Statistical Association
90 (432): 1200–1224.
Donoho, David L., Iain M. Johnstone, Gerard Kerkyacharian, and Dominique Picard. 1995. “Wavelet Shrinkage: Asymptopia?” Journal of the Royal Statistical Society. Series B (Methodological)
57 (2): 301–69.
Eggert, J., and E. Korner. 2004. “Sparse Coding and NMF.”
In 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541)
, 4:2529–2533 vol.4.
Ekanadham, C., D. Tranchina, and E. P. Simoncelli. 2011. “Recovery of Sparse Translation-Invariant Signals With Continuous Basis Pursuit.” IEEE Transactions on Signal Processing
59 (10): 4735–44.
Fan, Jianqing, and Runze Li. 2001. “Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties.” Journal of the American Statistical Association
96 (456): 1348–60.
Frazier, Michael W. 1999. An Introduction to Wavelets Through Linear Algebra. Springer.
Garg, Sahil, Irina Rish, Guillermo Cecchi, and Aurelie Lozano. 2017. “Neurogenesis-Inspired Dictionary Learning: Online Model Adaption in a Changing World.”
In arXiv:1701.06106 [Cs, Stat]
Gersho, Allen, and Robert M. Gray. 2012. Vector Quantization and Signal Compression. Springer Science & Business Media.
Giné, Evarist, and Richard Nickl. 2009. “Uniform Limit Theorems for Wavelet Density Estimators.” The Annals of Probability
37 (4): 1605–46.
Giryes, R., G. Sapiro, and A. M. Bronstein. 2016. “Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?” IEEE Transactions on Signal Processing
64 (13): 3444–57.
Goodwin, M M. 2001. “Multiscale Overlap-Add Sinusoidal Modeling Using Matching Pursuit and Refinements.”
In IEEE Workshop on Applications of Signal Processing to Audio and Acoustics
Goodwin, M M, and M Vetterli. 1999. “Matching Pursuit and Atomic Signal Models Based on Recursive Filter Banks.” IEEE Transactions on Signal Processing
47 (7): 1890–1902.
Goodwin, M., and M. Vetterli. 1997. “Atomic Decompositions of Audio Signals.”
In 1997 IEEE ASSP Workshop on Applications of Signal Processing to Audio and Acoustics, 1997
Gray, R. 1984. “Vector Quantization.” IEEE ASSP Magazine
1 (2): 4–29.
Gregor, Karol, and Yann LeCun. 2010. “Learning fast approximations of sparse coding.”
In Proceedings of the 27th International Conference on Machine Learning (ICML-10)
Grosse, Roger, Rajat Raina, Helen Kwong, and Andrew Y. Ng. 2007. “Shift-Invariant Sparse Coding for Audio Classification.”
In The Twenty-Third Conference on Uncertainty in Artificial Intelligence (UAI2007)
Gupta, Pawan, and Marianna Pensky. 2016. “Solution of Linear Ill-Posed Problems Using Random Dictionaries.” arXiv:1605.07913 [Math, Stat]
Hahn, William Edward, Stephanie Lewkowitz, Daniel C. Lacombe, and Elan Barenholtz. 2015. “Deep Learning Human Actions from Video via Sparse Filtering and Locally Competitive Algorithms.” Multimedia Tools and Applications
74 (22): 10097–110.
Han, Bin, Zhenpeng Zhao, and Xiaosheng Zhuang. 2016. “Directional Tensor Product Complex Tight Framelets with Low Redundancy.” Applied and Computational Harmonic Analysis
, Sparse Representations with Applications in Imaging Science, Data Analysis, and Beyond, Part IISI: ICCHAS Outgrowth, part 2, 41 (2): 603–37.
Han, Bin, and Xiaosheng Zhuang. 2015. “Smooth Affine Shear Tight Frames with MRA Structure.” Applied and Computational Harmonic Analysis
39 (2): 300–338.
Harte, Christopher, Mark Sandler, and Martin Gasser. 2006. “Detecting Harmonic Change in Musical Audio.”
In Proceedings of the 1st ACM Workshop on Audio and Music Computing Multimedia
, 21–26. AMCMM ’06. New York, NY, USA: ACM.
Henaff, Mikael, Kevin Jarrett, Koray Kavukcuoglu, and Yann LeCun. 2011. “Unsupervised Learning of Sparse Features for Scalable Audio Classification.”
Hoyer, Patrik O. n.d. “Non-Negative Matrix Factorization with Sparseness Constraints.” Journal of Machine Learning Research
5 (9): 1457–69.
Hoyer, P.O. 2002. “Non-Negative Sparse Coding.”
In Proceedings of the 2002 12th IEEE Workshop on Neural Networks for Signal Processing, 2002
Hyvärinen, Aapo, Jarmo Hurri, and Patrick O. Hoyer. 2009. Natural Image Statistics: A Probabilistic Approach to Early Computational Vision.
Vol. 39. Springer Science & Business Media.
Jafari, M. G., and M. D. Plumbley. 2011. “Fast Dictionary Learning for Sparse Representations of Speech Signals.” IEEE Journal of Selected Topics in Signal Processing
5 (5): 1025–31.
Jaillet, F., R. Gribonval, M. D. Plumbley, and H. Zayyani. 2010. “An L1 Criterion for Dictionary Learning by Subspace Identification.”
In 2010 IEEE International Conference on Acoustics, Speech and Signal Processing
Jung, Alexander. 2013. “An RKHS Approach to Estimation with Sparsity Constraints.”
In Advances in Neural Information Processing Systems 29
Koch, Parker, and Jason J. Corso. 2016. “Sparse Factorization Layers for Neural Networks with Limited Supervision.” arXiv:1612.04468 [Cs, Stat]
Koppel, Alec, Garrett Warnell, Ethan Stump, and Alejandro Ribeiro. 2016. “Parsimonious Online Learning with Kernels via Sparse Projections in Function Space.” arXiv:1612.04111 [Cs, Stat]
Lattner, Stefan, Monika Dorﬂer, and Andreas Arzt. 2019. “Learning Complex Basis Functions for Invariant Representations of Audio.”
In Proceedings of the 20th Conference of the International Society for Music Information Retrieval
Lee, Honglak, Alexis Battle, Rajat Raina, and Andrew Y. Ng. 2007. “Efficient Sparse Coding Algorithms.” Advances in Neural Information Processing Systems
Lee, Wee Sun, Peter L. Bartlett, and Robert C. Williamson. 1996. “Efficient Agnostic Learning of Neural Networks with Bounded Fan-in.” IEEE Transactions on Information Theory
42 (6): 2118–32.
Lewicki, M S, and T J Sejnowski. 1999. “Coding Time-Varying Signals Using Sparse, Shift-Invariant Representations.”
, 11:730–36. Denver, CO: MIT Press.
Lewicki, Michael S., and Terrence J. Sejnowski. 2000. “Learning Overcomplete Representations.” Neural Computation
12 (2): 337–65.
Liu, Tongliang, Dacheng Tao, and Dong Xu. 2016. “Dimensionality-Dependent Generalization Bounds for \(k\)-Dimensional Coding Schemes.” arXiv:1601.00238 [Cs, Stat]
Liu, T., and D. Tao. 2015. “On the Performance of Manhattan Nonnegative Matrix Factorization.” IEEE Transactions on Neural Networks and Learning Systems
PP (99): 1–1.
Lyu, Hanbaek, Deanna Needell, and Laura Balzano. 2020. “Online Matrix Factorization for Markovian Data and Applications to Network Dictionary Learning.” Journal of Machine Learning Research
21 (251): 1–49.
Mailhé, Boris, Rémi Gribonval, Pierre Vandergheynst, and Frédéric Bimbot. 2011. “Fast Orthogonal Sparse Approximation Algorithms over Local Dictionaries.” Signal Processing
, Advances in Multirate Filter Bank Structures and Multiscale Representations, 91 (12): 2822–35.
Mairal, Julien, Francis Bach, and Jean Ponce. 2014. Sparse Modeling for Image and Vision Processing
. Vol. 8.
Mairal, Julien, Francis Bach, Jean Ponce, and Guillermo Sapiro. 2009. “Online Dictionary Learning for Sparse Coding.”
In Proceedings of the 26th Annual International Conference on Machine Learning
, 689–96. ICML ’09. New York, NY, USA: ACM.
———. 2010. “Online Learning for Matrix Factorization and Sparse Coding.” The Journal of Machine Learning Research
Mallat, Stephane G. 1989. “Multiresolution Approximations and Wavelet Orthonormal Bases of L²(R).” Transactions of the American Mathematical Society
315 (1): 69–87.
Mallat, Stéphane. 2008. A Wavelet Tour of Signal Processing: The Sparse Way. Academic Press.
———. 2012. “Group Invariant Scattering.” Communications on Pure and Applied Mathematics
65 (10): 1331–98.
Mallat, Stéphane G., and Zhifeng Zhang. 1993. “Matching Pursuits with Time-Frequency Dictionaries.” IEEE Transactions on Signal Processing
41 (12): 3397–3415.
Mallat, S., and Z. Zhang. 1992. “Adaptive Time-Frequency Decomposition with Matching Pursuits.”
In Time-Frequency and Time-Scale Analysis, 1992., Proceedings of the IEEE-SP International Symposium
Marcus, Gary, Adam Marblestone, and Thomas Dean. 2014. “The atoms of neural computation.” Science
346 (6209): 551–52.
Mondal, Debashis, and Donald B. Percival. 2010. “M-Estimation of Wavelet Variance.” Annals of the Institute of Statistical Mathematics
64 (1): 27–53.
Mørup, Morten, Mikkel N. Schmidt, and Lars K. Hansen. 2007. “Shift Invariant Sparse Coding of Image and Music Data.” Journal of Machine Learning Research
Ngiam, Jiquan, Zhenghao Chen, Sonia A. Bhaskar, Pang W. Koh, and Andrew Y. Ng. 2011. “Sparse Filtering.”
In Advances in Neural Information Processing Systems 24
, edited by J. Shawe-Taylor, R. S. Zemel, P. L. Bartlett, F. Pereira, and K. Q. Weinberger, 1125–33. Curran Associates, Inc.
Olshausen, B. A., and D. J. Field. 1996. “Natural image statistics and efficient coding.” Network (Bristol, England)
7 (2): 333–39.
Olshausen, Bruno A, and David J Field. 2004. “Sparse Coding of Sensory Inputs.” Current Opinion in Neurobiology
14 (4): 481–87.
Opsomer, Jean, Yuedong Wang, and Yuhong Yang. 2001. “Nonparametric Regression with Correlated Errors.” Statistical Science
16 (2): -134-153.
Oyallon, Edouard, Eugene Belilovsky, and Sergey Zagoruyko. 2017. “Scaling the Scattering Transform: Deep Hybrid Networks.” arXiv Preprint arXiv:1703.08961
Plumbley, Mark D., Samer A. Abdallah, Thomas Blumensath, and Michael E. Davies. 2006. “Sparse Representations of Polyphonic Music.” Signal Processing
, Sparse Approximations in Signal and Image ProcessingSparse Approximations in Signal and Image Processing, 86 (3): 417–31.
Qian, Shie, and Dapang Chen. 1994. “Signal Representation Using Adaptive Normalized Gaussian Functions.” Signal Processing
36 (1): 1–11.
Rubinstein, Ron, A.M. Bruckstein, and Michael Elad. 2010. “Dictionaries for Sparse Representation Modeling.” Proceedings of the IEEE
98 (6): 1045–57.
Schniter, Philip, Lee C. Potter, and Justin Ziniel. 2008. “Fast Bayesian Matching Pursuit.”
In 2008 Information Theory and Applications Workshop
, 326–33. San Diego, CA, USA: IEEE.
Shen, Z. 2010. “Wavelet Frames and Image Restorations.”
, 2834–63. World Scientific.
Simoncelli, Eero P, and Bruno A Olshausen. 2001. “Natural Image Statistics and Neural Representation.” Annual Review of Neuroscience
24 (1): 1193–1216.
Smith, Evan C., and Michael S. Lewicki. 2006. “Efficient Auditory Coding.” Nature
439 (7079): 978–82.
Soh, Yong Sheng, and Venkat Chandrasekaran. 2017. “A Matrix Factorization Approach for Learning Semidefinite-Representable Regularizers.” arXiv:1701.01207 [Cs, Math, Stat]
Sprechmann, Pablo, Joan Bruna, and Yann LeCun. 2014. “Audio Source Separation with Discriminative Scattering Networks.” arXiv:1412.7022 [Cs]
Sulam, Jeremias, Aviad Aberdam, Amir Beck, and Michael Elad. 2020. “On Multi-Layer Basis Pursuit, Efficient Algorithms and Convolutional Neural Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence
42 (8): 1968–80.
Tang, Yuan Y. 2000. Wavelet Theory and Its Application to Pattern Recognition. World Scientific.
Torrence, Christopher, and Gilbert P Compo. 1998. “A Practical Guide to Wavelet Analysis.” Bulletin of the American Meteorological Society
79 (1): 61–78.
Tošić, Ivana, and Pascal Frossard. 2011. “Dictionary Learning: What Is the Right Representation for My Signal?” IEEE Signal Processing Magazine
28 (2): 27–38.
Tropp, J. A., and S. J. Wright. 2010. “Computational Methods for Sparse Solution of Linear Inverse Problems.” Proceedings of the IEEE
98 (6): 948–58.
Tropp, Joel A. 2006. “Algorithms for Simultaneous Sparse Approximation. Part II: Convex Relaxation.” Signal Processing
, Sparse Approximations in Signal and Image ProcessingSparse Approximations in Signal and Image Processing, 86 (3): 589–602.
Tsaig, Yaakov, and David L. Donoho. 2006a. “Breakdown of Equivalence Between the Minimal -Norm Solution and the Sparsest Solution.” Signal Processing
, Sparse Approximations in Signal and Image ProcessingSparse Approximations in Signal and Image Processing, 86 (3): 533–48.
———. 2006b. “Extensions of Compressed Sensing.” Signal Processing
, Sparse Approximations in Signal and Image ProcessingSparse Approximations in Signal and Image Processing, 86 (3): 549–71.
Vainsencher, Daniel, Shie Mannor, and Alfred M. Bruckstein. 2011. “The Sample Complexity of Dictionary Learning.” Journal of Machine Learning Research
12 (Nov): 3259–81.
Vetterli, Martin. 1999. “Wavelets: Approximation and Compression–a Review.”
, 3723:28–31. International Society for Optics and Photonics.
Wang, Yu Guang, and Houying Zhu. 2017. “Localized Tight Frames and Fast Framelet Transforms on the Simplex.” arXiv:1701.01595 [Cs, Math]
Wang, Yu Guang, and Xiaosheng Zhuang. 2016. “Tight Framelets and Fast Framelet Transforms on Manifolds.” arXiv:1608.04026 [Math]
Wang, Yu-Xiang, Alex Smola, and Ryan J. Tibshirani. 2014. “The Falling Factorial Basis and Its Statistical Applications.”
In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32
, 730–38. ICML’14. Beijing, China: JMLR.org.
Weidmann, Claudio, and Martin Vetterli. 2012. “Rate Distortion Behavior of Sparse Sources.” IEEE Transactions on Information Theory
58 (8): 4969–92.
Wohlberg, Brendt. 2017. “SPORCO: A Python Package for Standard and Convolutional Sparse Representations.” In.
Yaghoobi, M., L. Daudet, and M. E. Davies. 2009. “Parametric Dictionary Design for Sparse Coding.” IEEE Transactions on Signal Processing
57 (12): 4800–4810.
Yaghoobi, M., Sangnam Nam, R. Gribonval, and M.E. Davies. 2013. “Constrained Overcomplete Analysis Operator Learning for Cosparse Signal Modelling.” IEEE Transactions on Signal Processing
61 (9): 2341–55.
Yuan, Xiaotong, Ping Li, and Tong Zhang. 2014. “Gradient Hard Thresholding Pursuit for Sparsity-Constrained Optimization.”
In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32
, 127–35. Beijing, China: JMLR.org.
Zhou, Mingyuan, Haojun Chen, John Paisley, Lu Ren, Guillermo Sapiro, and Lawrence Carin. 2009. “Non-Parametric Bayesian Dictionary Learning for Sparse Image Representations.”
In Proceedings of the 22nd International Conference on Neural Information Processing Systems
, 22:2295–2303. NIPS’09. Red Hook, NY, USA: Curran Associates Inc.