A particular, analytically tractable way of overparameterizaion of optimisations to make them βniceβ in the sense of being easy to analyse, or solve, via the tools of convex optimisation. Popular in kernel methods, compressive sensing, matrix factorisation, phase retrieval, sparse coding and probably other things besides.

## Incoming

Francis Bach is interested in a particular specialisation, least squares relaxation. See Sums-of-squares for dummies: a view from the Fourier domain

In these last two years, I have been studying intensively sum-of-squares relaxations for optimization, learning a lot from many great research papers [1, 2], review papers [3], books [4, 5, 6, 7, 8], and even websites.

Much of the literature focuses on polynomials as the de facto starting point. While this leads to deep connections between many fields within mathematics, and many applications in various areas (optimal control, data science, etc.), the need for arguably non-natural hierarchies (at least for beginners) sometimes makes the exposition hard to follow at first, and notations a tiny bit cumbersome.

## References

*arXiv:1211.5608 [Cs, Math]*, November.

*Proceedings of the 2015 Conference on Innovations in Theoretical Computer Science*, 191β200. ITCS β15. New York, NY, USA: ACM.

*arXiv:1309.3117 [Cs, Math]*, September.

*arXiv:1501.00046 [Cs, Math, Stat]*, December.

*arXiv:1610.04210 [Cs, Math, Stat]*, October.

*Convex Optimization: Algorithms and Complexity*. Vol. 8. Foundations and Trends in Machine Learning. Now Publishers.

*arXiv Preprint arXiv:1601.07277*.

*arXiv:1610.07531 [Cs, Math]*, October.

*arXiv:1506.07540 [Cs, Stat]*, June.

*arXiv:1509.07983 [Cs, Math, Stat]*, September.

*arXiv Preprint arXiv:1607.02009*.

*IEEE Transactions on Signal Processing*65 (21): 5687β5701.

*Encyclopedia of Systems and Control*, edited by John Baillieul and Tariq Samad, 1289β95. London: Springer.

*IEEE Transactions on Information Theory*52 (3): 1030β51.

*Signal Processing*, Sparse Approximations in Signal and Image ProcessingSparse Approximations in Signal and Image Processing, 86 (3): 589β602.

## No comments yet. Why not leave one?