# Adversarial learning

Statistics against Shayṭtān

October 7, 2016 — February 21, 2022

Adversarial learning, where the noise is not purely random, but chosen to be the *worst possible noise for you* (subject to some rules of the game). This is in contrast to classic machine learning and statistics where the noise is purely random; Tyche is not “out to get you”.

As renewed in fame recently by the related (?) method of generative adversarial networks (although much older.)

The associated concept in normal human experience is Goodhardt’s law, which tells us that “people game the targets you set for them.”

🏗 discuss politics implied by treating the learning as a battle with a conniving adversary as opposed to an uncaringly random universe. I’m sure someone has done this well in a terribly eloquent blog post, but I haven’t found one I’d want to link to yet.

The toolset of adversarial techniques is broad. Game theory is an important one, but also computational complexity theory (how hard is to find adversarial inputs, or to learn despite them?) and lots of functional analysis and optimisation theory. Surely much other stuff I do not know because this is not really my field.

Applications are broad too — improving ML but also infosec, risk management etc.

## 1 Incoming

Adversarial attacks can be terrorism or freedom-fighting, depending on the pitch, natch: From data strikes to data poisoning, how consumers can take back control from corporations.

## 2 References

*arXiv:0903.5328 [Cs, Stat]*.

*arXiv:1701.04862 [Stat]*.

*International Conference on Machine Learning*.

*arXiv:1703.00573 [Cs]*.

*International Conference on Machine Learning*.

*Regret analysis of stochastic and nonstochastic multi-armed bandit problems*.

*arXiv:1202.4473 [Cs]*.

*Nature Machine Intelligence*.

*arXiv:1901.09496 [Cs, Stat]*.

*arXiv:1704.02906 [Cs, Stat]*.

*Advances in Neural Information Processing Systems 27*. NIPS’14.

*arXiv:1412.6572 [Cs, Stat]*.

*Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences*.

*The Annals of Statistics*.

*arXiv:1705.07164 [Cs, Stat]*.

*Advances In Neural Information Processing Systems*.

*Advances in Neural Information Processing Systems 29*.

*arXiv:1611.00350 [Cs, Stat]*.

*arXiv:1512.09300 [Cs, Stat]*.

*Handbook of Game Theory with Economic Applications*.

*arXiv:2106.03007 [Cs, Econ, Stat]*.

*Advances in Neural Information Processing Systems 29*.

*arXiv:1511.06434 [Cs]*.

*arXiv:1905.05927 [Cs, Math, Stat]*.

*Statistical Science*.

*Advances in Neural Information Processing Systems*.

*Proceedings of the National Academy of Sciences*.

*Advances in Neural Information Processing Systems 30*.

*Statistics, Probability and Game Theory: Papers in Honor of David Blackwell*.

*Proceedings of The 24th International Conference on Artificial Intelligence and Statistics*.

*Proceedings of the 38th International Conference on Machine Learning*.

*arXiv:1710.04677 [Cs, Stat]*.