Filter design, linear

Especially digital

Linear Time-Invariant (LTI) filter design is a field of signal processing, and a special case of state filtering that doesn’t necessarily involve a hidden state.

z-Transforms, bilinear transforms, Bode plots, design etc.

I am going to consider this in discrete time (i.e. for digital implementation) unless otherwise stated, because I’m implementing this in software, not with capacitors or whatever. For reasons of tradition we usually start from continuous time systems, but this is not necessarily a convenient mathematical or practical starting point for my own work.

This notebook is about designing properties of systems to given specifications, e.g. signal to noise ratios, uncertainty principles…

For inference of filter parameters from data, you want system identification; and for working out the hidden states of the system given the parameters, you want the more general estimation theory in state filters.

Related, musical: delays and reverbs.

Relationship of discrete LTI to continuous time filters

πŸ— See signal sampling.

Quick and dirty digital filter design

State-Variable Filters

A vacuous name; every recursive filter has state variables. Less ambiguous: Chamberlin and ZΓΆlzer filters.

Nigel Redmon, digital SVF intro.

Time-varying IIR filters

By popular acclaim, Laroche (2007) seems to be the canonical example of design rules for filters that vary over time, and Wishnick (2014) is the most popular single-channel application, which proves the effectiveness of the cytomic variable filters The latter has source code online. See also (Carini, Mathews, and Sicuranza 1999; Murakoshi, Nishihara, and Watanabe 1994; Koshita, Abe, and Kawamata 2018).

On graphs

No time to go deep on this rn, but signal processing on graphs is a thing.


Abe, T., T. Kobayashi, and S. Imai. 1995. β€œHarmonics Tracking and Pitch Extraction Based on Instantaneous Frequency.” In International Conference on Acoustics, Speech, and Signal Processing, 1995. ICASSP-95, 1:756–759 vol.1.
Adcock, Ben, and Anders C. Hansen. 2016. β€œGeneralized Sampling and Infinite-Dimensional Compressed Sensing.” Foundations of Computational Mathematics 16 (5): 1263–323.
Adcock, Ben, Anders C. Hansen, and Bogdan Roman. 2015. β€œThe Quest for Optimal Sampling: Computationally Efficient, Structure-Exploiting Measurements for Compressed Sensing.” In Compressed Sensing and Its Applications: MATHEON Workshop 2013, edited by Holger Boche, Robert Calderbank, Gitta Kutyniok, and Jan VybΓ­ral, 143–67. Applied and Numerical Harmonic Analysis. Cham: Springer International Publishing.
Adcock, Ben, Anders Hansen, Bogdan Roman, and Gerd Teschke. 2014. β€œGeneralized Sampling: Stable Reconstructions, Inverse Problems and Compressed Sensing over the Continuum.” In Advances in Imaging and Electron Physics, edited by Peter W. Hawkes, 182:187–279. Elsevier.
Alliney, S. 1992. β€œDigital Filters as Absolute Norm Regularizers.” IEEE Transactions on Signal Processing 40 (6): 1548–62.
Antoniou, Andreas. 2005. Digital signal processing: signals, systems and filters. New York: McGraw-Hill.
Berkhout, A. J., and P. R. Zaanen. 1976. β€œA Comparison Between Wiener Filtering, Kalman Filtering, and Deterministic Least Squares Estimation*.” Geophysical Prospecting 24 (1): 141–97.
Carini, A., V.J. Mathews, and G.L. Sicuranza. 1999. β€œSufficient Stability Bounds for Slowly Varying Direct-Form Recursive Linear Filters and Their Applications in Adaptive IIR Filters.” IEEE Transactions on Signal Processing 47 (9): 2561–67.
Chamberlin, Hal. 1985. Musical applications of microprocessors. 2nd ed. Hasbrouck Heights, N.J: Hayden Book Co.
Ephremidze, L., G. Janashia, and E. Lagvilava. 2007. β€œA New Efficient Matrix Spectral Factorization Algorithm.” In SICE Annual Conference 2007, 20–23.
Geronimo, Jeffrey S., and Hugo J. Woerdeman. 2004. β€œPositive Extensions, FejΓ©r-Riesz Factorization and Autoregressive Filters in Two Variables.” Annals of Mathematics 160 (3): 839–906.
Harvey, Andrew, and Alessandra Luati. 2014. β€œFiltering With Heavy Tails.” Journal of the American Statistical Association 109 (507): 1112–22.
Hohmann, V. 2002. β€œFrequency Analysis and Synthesis Using a Gammatone Filterbank.” Acta Acustica United with Acustica 88 (3): 433–42.
Isufi, Elvin, Andreas Loukas, Andrea Simonetto, and Geert Leus. 2017. β€œAutoregressive Moving Average Graph Filtering.” IEEE Transactions on Signal Processing 65 (2): 274–88.
Koshita, Shunsuke, Masahide Abe, and Masayuki Kawamata. 2018. β€œRecent Advances in Variable Digital Filters.” Digital Systems, November.
Laroche, Jean. 2007. β€œOn the Stability of Time-Varying Recursive Filters.” Journal of the Audio Engineering Society 55 (6): 460–71.
Linkwitz, Siegfried H. 1976. β€œActive Crossover Networks for Noncoincident Drivers.” Journal of the Audio Engineering Society 24 (1): 2–8.
Marple, S. Lawrence, Jr. 1987. Digital Spectral Analysis with Applications.
Martin, R. J. 1998. β€œAutoregression and Irregular Sampling: Filtering.” Signal Processing 69 (3): 229–48.
β€”β€”β€”. 1999. β€œAutoregression and Irregular Sampling: Spectral Estimation.” Signal Processing 77 (2): 139–57.
Moon, Todd K., and Wynn C. Stirling. 2000. Mathematical Methods and Algorithms for Signal Processing. Upper Saddle River, NJ: Prentice Hall.
Moorer, J.A. 1974. β€œThe Optimum Comb Method of Pitch Period Analysis of Continuous Digitized Speech.” IEEE Transactions on Acoustics, Speech and Signal Processing 22 (5): 330–38.
Murakoshi, Nobuo, Akinori Nishihara, and Eiji Watanabe. 1994. β€œSynthesis of Variable IIR Digital Filters with Complex Coefficients.” Electronics and Communications in Japan (Part III: Fundamental Electronic Science) 77 (5): 46–57.
Narasimha, M. J., A. Ignjatovic, and P. P. Vaidyanathan. 2002. β€œChromatic Derivative Filter Banks.” IEEE Signal Processing Letters 9 (7): 215–16.
Necciari, T., P. Balazs, N. Holighaus, and P.L. Sondergaard. 2013. β€œThe ERBlet Transform: An Auditory-Based Time-Frequency Representation with Perfect Reconstruction.” In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 498–502.
Nyquist, H. 1928. β€œCertain Topics in Telegraph Transmission Theory.” Transactions of the American Institute of Electrical Engineers 47 (2): 617–44.
Oppenheim, Alan V., Ronald W. Schafer, and John R. Buck. 1999. Discrete-Time Signal Processing. 2nd ed. Upper Saddle River, N.J: Prentice Hall.
Orfanidis, Sophocles J. 1996. Introduction to Signal Processing. Prentice Hall Signal Processing Series. Englewood Cliffs, N.J: Prentice Hall.
Prandoni, Paolo, and Martin Vetterli. 2008. Signal processing for communications. Communication and information sciences. Lausanne: EPFL Press.
Robertson, Andrew, Adam M. Stark, and Mark D. Plumbley. 2011. β€œReal-Time Visual Beat Tracking Using a Comb Filter Matrix.” In Proceedings of the International Computer Music Conference 2011.
Schlecht, Sebastian J., and EmanuΓ«l A. P. Habets. 2015. β€œTime-Varying Feedback Matrices in Feedback Delay Networks and Their Application in Artificial Reverberation.” The Journal of the Acoustical Society of America 138 (3): 1389–98.
Sebek, Michael. 2015. β€œSpectral Factorization.” In Encyclopedia of Systems and Control, edited by John Baillieul and Tariq Samad, 1289–95. London: Springer.
Shuman, D. I., S. K. Narang, P. Frossard, A. Ortega, and P. Vandergheynst. 2013. β€œThe Emerging Field of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Domains.” IEEE Signal Processing Magazine 30 (3): 83–98.
Shuman, David I., Pierre Vandergheynst, and Pascal Frossard. 2011. β€œChebyshev Polynomial Approximation for Distributed Signal Processing.” 2011 International Conference on Distributed Computing in Sensor Systems and Workshops (DCOSS), June, 1–8.
Smith, Julius O. 2007. Introduction to Digital Filters with Audio Applications. W3K Publishing.
β€”β€”β€”. 2010. β€œAudio Signal Processing in Faust.” Online Tutorial: Https://Ccrma. Stanford. Edu/Jos/Aspf.
β€”β€”β€”. n.d. β€œDigital State-Variable Filters.”
Smith, Julius O., and Romain Michon. 2011. β€œNonlinear Allpass Ladder Filters in Faust.” In Proceedings of the 14th International Conference on Digital Audio Effects (DAFx-11), 361–64.
Stilson, Tim, and Julius Smith. 1996. β€œAnalyzing the Moog VCF with Considerations for Digital Implementation.” In.
Stoica, Petre, and Randolph L. Moses. 2005. Spectral Analysis of Signals. 1 edition. Upper Saddle River, N.J: Prentice Hall.
Wise, Duane K. 2006. β€œThe Modified Chamberlin and ZΓΆlzer Filter Structures.” In Proc. Of the 9th Int. Conference on Digital Audio Effects (DAFx-06), 2:3.
Wishnick, Aaron. 2014. β€œTime-Varying Filters for Musical Applications.” In DAFx, 69–76.
Zavalishin, Vadim. n.d. β€œThe Art of VA Filter Design.”

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.