A classic. Surprisingly deep.

A few non-comprehensive notes to approximating by the arbitrary-but-convenient expedient of minimising the sum of the squares of the deviances.

As used in many many problems. e.g. lasso regression.

Nonlinear least squares with ceres-solver:

Ceres Solve is an open source C++ library for modeling and solving large, complicated optimization problems. It can be used to solve Non-linear Least Squares problems with bounds constraints and general unconstrained optimization problems. It is a mature, feature rich, and performant library that has been used in production at Google since 2010.

Boyd and Vandenbergheβs Julia Companion to their Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares is a solid introduction to both linear algebra and Julia, focussing especially on least-squares problems.

## Iteratively reweighted

## in mechanism design

TBD. See quadratic voting and public goods provision (Buterin, Hitzig, and Weyl 2019).

## References

*arXiv:1701.09120 [Math, Stat]*, January.

*Management Science*65 (11): 5171β87.

*IEEE International Conference on Acoustics, Speech and Signal Processing, 2008. ICASSP 2008*, 3869β72.

*arXiv:1610.08244 [Stat]*, October.

*Mathematical Programming*143 (1-2): 371β83.

*arXiv:1702.06429 [Math, Stat]*, February.

*Computational Statistics & Data Analysis*, Nonlinear Methods and Data Mining, 38 (4): 367β78.

*The Annals of Applied Statistics*1 (2): 302β32.

*Journal of Statistical Software*33 (1): 1β22.

*IEEE Transactions on Signal Processing*57 (12): 4686β98.

*arXiv:1011.1576 [Cs]*, November.

*Statistical Science*12 (4): 279β300.

*Operations Research*63 (5): 1026β43.

*The Annals of Statistics*35 (3): 1012β30.

*Physical Review E*83 (3): 036701.

*Computational Optimization and Applications*48 (2): 273β307.

## No comments yet. Why not leave one?