Function approximation and interpolation

June 9, 2016 — June 9, 2016

convolution
functional analysis
Hilbert space
nonparametric
signal processing
sparser than thou
Figure 1

A method of function approximation.

Special superpowers: Easy to differentiate and integrate.

Special weakness: many free parameters, not so easy to do in high dimension.

1 References

Boyd, Hastie, Boyd, et al. 2016. “Saturating Splines and Feature Selection.” arXiv:1609.06764 [Stat].
Cheney, and Light. 2009. A Course in Approximation Theory.
Dierckx. 1996. Curve and Surface Fitting Splines.
Ekanadham, Tranchina, and Simoncelli. 2011. “Recovery of Sparse Translation-Invariant Signals With Continuous Basis Pursuit.” IEEE Transactions on Signal Processing.
Elbrächter, Perekrestenko, Grohs, et al. 2021. “Deep Neural Network Approximation Theory.” IEEE Transactions on Information Theory.
Fomel. 2000. “Inverse B-Spline Interpolation.”
Hou, and Andrews. 1978. “Cubic Splines for Image Interpolation and Digital Filtering.” IEEE Transactions on Acoustics, Speech and Signal Processing.
Poggio, and Girosi. 1990. “Networks for Approximation and Learning.” Proceedings of the IEEE.
Ramsay. 1988. “Monotone Regression Splines in Action.” Statistical Science.
Unser, Michael, Aldroubi, and Eden. 1991. “Fast B-Spline Transforms for Continuous Image Representation and Interpolation.” IEEE Transactions on Pattern Analysis and Machine Intelligence.
Unser, M., Aldroubi, and Eden. 1993a. “B-Spline Signal Processing. I. Theory.” IEEE Transactions on Signal Processing.
———. 1993b. “B-Spline Signal Processing. II. Efficiency Design and Applications.” IEEE Transactions on Signal Processing.
Wang, Smola, and Tibshirani. 2014. “The Falling Factorial Basis and Its Statistical Applications.” In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32. ICML’14.
Weinert, and Kailath. 1974. “Minimum Energy Control Using Spline Functions.” In 1974 IEEE Conference on Decision and Control Including the 13th Symposium on Adaptive Processes.
Wood. 1994. “Monotonic Smoothing Splines Fitted by Cross Validation.” SIAM Journal on Scientific Computing.