# Gradient descent, continuous, primal/dual formulations.

Placeholder; I need to update this with real info, given how often I need to know it.

## Lagrange multipliers

Constrained optimisation using Lagrange’s one weird trick, and the Karush—Kuhn—Tucker conditions. The search for saddle points and roots.

## Duals

The types of optimisation problems you can create from a given set of constraints and objectives, based on primal and dual formulations.

There are several different duals and I don’t know their relations. Legendre-Fenchel dual, Lagrange dual, Wolfe dual… however these all work.

🏗 Discuss role of $$L_p$$ norms.