Signal sampling

Discrete sample representation of continuous stochastic processes

Signal sampling is the study of approximating continuous signals with discrete ones and vice versa. What if the signal you are trying to recover is random, but you have a model for that randomness? Now you are sampling a stochastic process.

Related: state filtering.


Bostan, E., U. S. Kamilov, M. Nilchian, and M. Unser. 2013. “Sparse Stochastic Processes and Discretization of Linear Inverse Problems.” IEEE Transactions on Image Processing 22 (7): 2699–2710.

Broersen, Piet M. T. 2005. “Time Series Analysis for Irregularly Sampled Data.” IFAC Proceedings Volumes, 16th IFAC World Congress, 38 (1): 154–59.

Broersen, P. M. T., and R. Bos. 2006. “Estimating Time-Series Models from Irregularly Spaced Data.” In IEEE Transactions on Instrumentation and Measurement, 55:1124–31.

Coulaud, Benjamin, and Frédéric JP Richard. 2018. “A Consistent Framework for a Statistical Analysis of Surfaces Based on Generalized Stochastic Processes.”

Jones, Richard H. 1981. “Fitting a Continuous Time Autoregression to Discrete Data.” In Applied Time Series Analysis II, 651–82.

———. 1984. “Fitting Multivariate Models to Unequally Spaced Data.” In Time Series Analysis of Irregularly Observed Data, 158–88. Springer.

Lahalle, E., G. Fleury, and A. Rivoira. 2004. “Continuous ARMA Spectral Estimation from Irregularly Sampled Observations.” In Proceedings of the 21st IEEE Instrumentation and Measurement Technology Conference, 2004. IMTC 04, 2:923–27 Vol.2.

Larsson, Erik K., and Torsten Söderström. 2002. “Identification of Continuous-Time AR Processes from Unevenly Sampled Data.” Automatica 38 (4): 709–18.

Lii, Keh-Shin, and Elias Masry. 1992. “Model Fitting for Continuous-Time Stationary Processes from Discrete-Time Data.” Journal of Multivariate Analysis 41 (1): 56–79.

Maravic, I., and M. Vetterli. 2005. “Sampling and Reconstruction of Signals with Finite Rate of Innovation in the Presence of Noise.” IEEE Transactions on Signal Processing 53 (8): 2788–2805.

Marziliano, P., M. Vetterli, and T. Blu. 2006. “Sampling and Exact Reconstruction of Bandlimited Signals with Additive Shot Noise.” IEEE Transactions on Information Theory 52 (5): 2230–3.

Matheron, G. 1973. “The Intrinsic Random Functions and Their Applications.” Advances in Applied Probability 5 (3): 439–68.

Murray-Smith, Roderick, and Barak A. Pearlmutter. 2005. “Transformations of Gaussian Process Priors.” In Deterministic and Statistical Methods in Machine Learning, edited by Joab Winkler, Mahesan Niranjan, and Neil Lawrence, 110–23. Lecture Notes in Computer Science. Springer Berlin Heidelberg.

O’Callaghan, Simon Timothy, and Fabio T. Ramos. 2011. “Continuous Occupancy Mapping with Integral Kernels.” In Twenty-Fifth AAAI Conference on Artificial Intelligence.

Scargle, Jeffrey D. 1981. “Studies in Astronomical Time Series Analysis. I-Modeling Random Processes in the Time Domain.” The Astrophysical Journal Supplement Series 45: 1–71.

Söderström, T., and M. Mossberg. 2000. “Performance Evaluation of Methods for Identifying Continuous-Time Autoregressive Processes.” Automatica 1 (36): 53–59.

Sun, Qiyu, and Michael Unser. 2012. “Left-Inverses of Fractional Laplacian and Sparse Stochastic Processes.” Advances in Computational Mathematics 36 (3): 399–441.

Tan, V. Y. F., and V. K. Goyal. 2008. “Estimating Signals with Finite Rate of Innovation from Noisy Samples: A Stochastic Algorithm.” IEEE Transactions on Signal Processing 56 (10): 5135–46.

Unser, M. 2015. “Sampling and (Sparse) Stochastic Processes: A Tale of Splines and Innovation.” In 2015 International Conference on Sampling Theory and Applications (SampTA), 221–25.

Unser, Michael A., and Pouya Tafti. 2014. An Introduction to Sparse Stochastic Processes. New York: Cambridge University Press.

Unser, M., P. D. Tafti, A. Amini, and H. Kirshner. 2014. “A Unified Formulation of Gaussian Vs Sparse Stochastic Processes - Part II: Discrete-Domain Theory.” IEEE Transactions on Information Theory 60 (5): 3036–51.

Unser, M., P. D. Tafti, and Q. Sun. 2014. “A Unified Formulation of Gaussian Vs Sparse Stochastic Processes—Part I: Continuous-Domain Theory.” IEEE Transactions on Information Theory 60 (3): 1945–62.

Wolfe, Stephen James. 1982. “On a Continuous Analogue of the Stochastic Difference Equation Xn=[Rho]Xn-1+Bn.” Stochastic Processes and Their Applications 12 (3): 301–12.

Yadrenko, Mikhail Iosifovich. 1983. Spectral Theory of Random Fields. Translation Series in Mathematics and Engineering. New York, NY: Optimization Software.

Yaglom, A. M. 1987. Correlation Theory of Stationary and Related Random Functions: Supplementary Notes and References. Springer Series in Statistics. New York, NY: Springer Science & Business Media.