On the strategic inception of uncertainty. Fun keyword here: Agnotology, the study of ignorance.
Possibly one reason this works is the notorious information avoidance problem. (Case et al. 2005)
The assumption that individuals actively seek information underlies much of psychological theory and communication practice, as well as most models of the information-seeking process. However, much research has also noted that sometimes people avoid information, if paying attention to it will cause mental discomfort or dissonance. Cancer information in general and genetic screening for cancer in particular are discussed as examples to illustrate this pattern.
I would be open to the hypothesis that a given incidence of weird social dynamics is a purely emergent behavior, as opposed to malicious conspiracy; but perhaps in this area there a startling number of cases where conspiracy is demonstrably the explanation:
The basic tenet is simple: carefully manipulate public perception about your product to make it sound like we either don’t know that it’s dangerous, or that the harm is caused by something else. Once the public is confused or thoroughly mislead, it’s impossible to get political consensus on any kind of regulation, and you can keep doing business as you see fit.
The tobacco industry is the most famous of such doubt-mongerers for having been caught in the act. But as “Merchants of Doubt” (Oreskes and Conway 2010) recounts, there are many other such examples (pesticides, mattress flame retardants, acid rain, the ozone hole, and most consequentially for our civilization, climate change). The industries behind such campaigns knew full well that they were selling a harmful product, and they just kept doing it until they got caught.
A particularly lurid case might be that of Syngenta going after Tyrone Hayes because his research made their product sound dangerous.
Tim Mitchell’s lecture on the government of uncertainty is also entertaining.
[we have an article] asking why politicians were influenced by a key group of economists early in the Great Recession but not in the later part. […]what was crucial was the perceived degree of unanimity among economists. When the profession of economics appears to be speaking with one voice, politicians are more likely to listen, sometimes even when they don’t want to. When the profession appears to be split, politicians are much better able to pick and choose.
Unfortunately for economists, this offers incentives to politicians who don’t much like what economists are saying to elevate and promote dissident economists to create the appearance of intellectual division.
David Michaels, Science for Sale
Unfortunately, though, this story is old news: most people, especially Americans, have come to expect corporations to put profit above all else. Still, we mostly don’t expect there to be mercenary scientists. Science is supposed to be constant, apolitical, and above the fray. This commonsense view misses the rise of science-for-sale specialists over the last several decades and a “product defense industry” that sustains them—a cabal of apparent experts, PR flaks, and political lobbyists who use bad science to produce whatever results their sponsors want.
Curiosities sucha s perhaps25% of all anti-climate propoganda being bots might fit in here.
Case, Donald O., James E. Andrews, J. David Johnson, and Suzanne L. Allard. 2005. “Avoiding Versus Seeking: The Relationship of Information Seeking to Avoidance, Blunting, Coping, Dissonance, and Related Concepts.” Journal of the Medical Library Association 93 (3): 353–62. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1175801/.
Golman, Russell, David Hagmann, and George Loewenstein. 2017. “Information Avoidance.” Journal of Economic Literature 55 (1): 96–135. https://doi.org/10.1257/jel.20151245.
Jackall, Robert. 2009. Moral Mazes: The World of Corporate Managers. Updated edition. Oxford ; New York: Oxford University Press.
O’connor, Cailin, and James Owen Weatherall. 2019. The Misinformation Age: How False Beliefs Spread. 1 edition. New Haven: Yale University Press.
Oreskes, Naomi, and Erik M. Conway. 2010. Merchants of Doubt: How a Handful of Scientists Obscured the Truth on Issues from Tobacco Smoke to Global Warming. 1 edition. New York: Bloomsbury Press.