History, sociology and philosophy thereof

I do not myself have a much to say about the philosophy of science as such. I read a lot of Lakatos that one time.

Mostly I am interested in a kind of qualitative mechanism design musing as it pertains to designing better peer-review.

What is science?

Not really in that vein, check out amusing curmudgeon: DC Stove, Popper and after: Four modern irrationalists.

Question: does science advance one funeral at a time?.

Star Scientist Funeral

Memetics of Science

There are a lot of models of what scientific consensus might mean. (Kuhnian paradigms, degereative research programs or whatever Lakatos called them, etc).

Science communication

I quite like this pyramid of science diffusion model which breaks apart the science/public nexus with a little more nuance.

I think a lot of things are getting obscured by the term “scientific establishment” or “scientific consensus”. Imagine a pyramid with the following levels from top to bottom:

FIRST, specialist researchers in a field. So for example the people doing studies on the effect of dietary cholesterol, or the people dissecting monkey brains to see how much serotonin is in them. These people always have the latest cutting-edge experimental results and a good knowledge of the issues involved in the field.

SECOND, non-specialist researchers in a broader field. Nutrition scientists in general. The guy who is interested in Vitamin B, but goes to the same conferences as the guys studying cholesterol. The research psychiatrist working on schizophrenia, but who maintains a keen interest in what her colleagues over in the depression lab are doing. They know enough about the broad principles of the field to be able to understand and evaluate new ideas more quickly than everybody else, but they still only learn about them the same way everyone else does – by waiting for the specialist researchers to tell them.

THIRD, the organs and administrators of a field who help set guidelines. The head of the USDA who’s in charge of looking over the Food Pyramid to make sure it’s accurate. The APA Committee for deciding exactly what wording to use in the guidelines on depression treatment. The head of Harvard Medical School who has to decide what to put in the curriculum. The editor of the New England Journal of Medicine, who has to decide what gets published.

FOURTH, science journalism, meaning everyone from the science reporters at the New York Times to the guys writing books with titles like The Antidepressant Wars to random bloggers.

ALSO FOURTH IN A DIFFERENT COLUMN OF THE PYRAMID BECAUSE THIS IS A HYBRID GREEK PYRAMID THAT HAS COLUMNS, “fieldworkers”, aka the professionals we charge with putting the research into practice. In nutrition this is doctors and dieticians, who directly inform their patients what to eat. In education research this could be teachers and principals who directly decide how classes will get taught. In sociology it might be the police chief trying to institute a new crime-fighting program. Et cetera.

FIFTH, the general public.

Two other models of interest:

  1. the hype cycle, and
  2. the simulacra.

The problems of journals in particular

See publication bias.


See softmethodology.


Ackerman, Frank, Stephen J DeCanio, Richard Howarth, and Kristen Sheeran. 2009. “Limitations of Integrated Assessment Models of Climate Change.” Climatic Change 95: 297–315.
Agassi, Joseph. 1974. “The Logic of Scientific Inquiry.” Synthese 26: 498–514.
Alon, Uri. 2009. “How to Choose a Good Scientific Problem.” Molecular Cell 35 (6): 726–28.
Arbesman, Samuel, and Nicholas A Christakis. 2011. “Eurekometrics: Analyzing the Nature of Discovery.” PLoS Comput Biol 7 (6): –1002072.
Azoulay, Pierre, Christian Fons-Rosen, and Joshua S. Graff Zivin. 2015. “Does Science Advance One Funeral at a Time?” Working Paper 21788. National Bureau of Economic Research.
Baez, John C, and Mike Stay. 2009. “Physics, Topology, Logic and Computation: A Rosetta Stone.”
Baldwin, Melinda. 2018. “Scientific Autonomy, Public Accountability, and the Rise of ‘Peer Review’ in the Cold War United States.” Isis 109 (3): 538–58.
Blaug, Mark. 1992. The Methodology of Economics : Or, How Economists Explain. Cambridge Surveys of Economic Literature. Cambridge University Press.
Budd, Aidan, Holger Dinkel, Manuel Corpas, Jonathan C. Fuller, Laura Rubinat, Damien P. Devos, Pierre H. Khoueiry, et al. 2015. “Ten Simple Rules for Organizing an Unconference.” PLoS Computational Biology 11 (1).
Cartwright, Nancy. 1997. “Models: The Blueprints for Laws.” Philosophy of Science 64: -292-303.
Chaitin, Gregory J. 2002. “The Intelligibility of the Universe and the Notions of Simplicity, Complexity and Irreducibility.”
Cross, Rod. 1982. “The Duhem-Quine Thesis, Lakatos and the Appraisal of Theories in Macroeconomics.” The Economic Journal 92: 320–40.
Delfanti, Alessandro. 2020. “The Financial Market of Ideas: A Theory of Academic Social Media.” Social Studies of Science, October, 0306312720966649.
Devezer, Berna, Luis G. Nardin, Bert Baumgaertner, and Erkan Ozge Buzbas. 2019. “Scientific Discovery in a Model-Centric Framework: Reproducibility, Innovation, and Epistemic Diversity.” PLOS ONE 14 (5): e0216125.
Freedman, David A., and Philip B Stark. 2009. “What Is the Chance of an Earthquake?” In Statistical Models and Causal Inference: A Dialogue with the Social Sciences, edited by David Collier, Jasjeet S. Sekhon, and Philip B. Stark. Cambridge: Cambridge University Press.
Funtowicz, Silvio O, and Jerome R Ravetz. 1994. “The Worth of a Songbird: Ecological Economics as a Post-Normal Science.” Ecological Economics 10: 197–207.
Gelman, Andrew. 2011. “Experimental Reasoning in Social Science.” In Field Experiments and Their Critics.
Greenberg, Steven A. 2009. “How Citation Distortions Create Unfounded Authority: Analysis of a Citation Network.” BMJ 339 (July): b2680.
Healy, Kieran. 2015. “The Performativity of Networks.” European Journal of Sociology 56 (02): 175–205.
Hodges, James S. 2019. “Statistical Methods Research Done as Science Rather Than Mathematics.” arXiv:1905.08381 [stat], May.
Hogarth, Robin M, and Melvin W Reder. 1987. Rational Choice: The Contrast Between Economics and Psychology. Univ of Chicago Pr (Tx).
Hutchins, Edwin. 1996. Cognition in the Wild. The MIT Press.
Ioannidis, John P. 2005. “Why Most Published Research Findings Are False.” PLoS Medicine 2 (8): –124.
Jaynes, Edwin Thompson. 1963. “Information Theory and Statistical Mechanics.” In Statistical Physics. Vol. 3. Brandeis University Summer Institute Lectures in Theoretical Physics.
Jeppesen, Lars Bo, and Karim R. Lakhani. 2010. “Marginality and Problem-Solving Effectiveness in Broadcast Search.” Organization Science 21 (5): 1016–33.
Kerkhoff, Lorrae van. 1996. “Through the Looking Glass: The Role and Analysis of Metaphorical Language in Interdisciplinary Science.”
Kirman, Alan. 1992. “Whom or What Does the Representative Individual Represent?” The Journal of Economic Perspectives 6 (2): -117-136.
———. 2010. “Learning in Agent Based Models.”
Lakatos, Imre. 1980. The Methodology of Scientific Research Programmes: Volume 1 : Philosophical Papers. Cambridge University Press.
Lakoff, George, and Mark Johnson. 1980. Metaphors We Live By. University Of Chicago Press.
Lo, Andrew W, and Mark T Mueller. 2010. “WARNING: Physics Envy May Be Hazardous To Your Wealth!”
Medawar, Peter B. 1969. Induction and Intuition in Scientific Thought. American Philosophical Society Philadelphia.
———. 1982. Pluto’s Republic. Oxford University Press.
———. 1984. The Limits of Science. Harper & Row.
Merali, Zeeya. 2010. “Computational Science: Error.” Nature 467: 775–77.
Midgley, Gerald. 2001. Systemic Intervention - Philosophy, Methodology and Practice (Contemporary Systems Thinking) (Contemporary Systems Thinking). Springer.
Navarro, Danielle J. 2019. “Between the Devil and the Deep Blue Sea: Tensions Between Scientific Judgement and Statistical Model Selection.” Computational Brain & Behavior 2 (1): 28–34.
Palmer, Victor. 2006. “Deception and Convergence of Opinions Part 2: The Effects of Reproducibility.” Journal of Artificial Societies and Social Simulation 9.
Ridley, J, N Kolm, R P Freckelton, and M J G Gage. 2007. “An Unexpected Influence of Widely Used Significance Thresholds on the Distribution of Reported P-Values.” Journal of Evolutionary Biology 20: 1082–89.
Robbins, Lionel. 1932. An Essay on the Nature and Significance of Economic Science. Macmillan.
Rzhetsky, Andrey, Jacob G. Foster, Ian T. Foster, and James A. Evans. 2015. “Choosing Experiments to Accelerate Collective Discovery.” Proceedings of the National Academy of Sciences 112 (47): 14569–74.
Sen, Amartya K. 1977. “Rational Fools: A Critique of the Behavioral Foundations of Economic Theory.” Philosophy and Public Affairs 6: 317–44.
Sethna, James P. 2006. Statistical Mechanics: Entropy, Order Parameters, and Complexity. Oxford University Press, USA.
Spranzi, Marta. 2004. “Galileo and the Mountains of the Moon: Analogical Reasoning, Models and Metaphors in Scientific Discovery.” Journal of Cognition and Culture 4 (3): 451–83.
Stearns, Stephen C. 1987. “Some Modest Advice for Graduate Students.” Bulletin of the Ecological Society of America 68 (2): 145–50.
Stove, David Charles. 1982. Popper and After: Four Modern Irrationalists. Pergamon.
Suppes, Patrick. 2002. Representation and Invariance of Scientific Structures. CSLI Publications.
Thagard, Paul. 1993. “Societies of Minds: Science as Distributed Computing.” Studies in History and Philosophy of Modern Physics 24: 49.
———. 1994. “Mind, Society, and the Growth of Knowledge.” Philosophy of Science 61.
———. 1997. “Collaborative Knowledge.” Noûs 31 (2): 242–61.
———. 2005. “How to Be a Successful Scientist.” Scientific and Technological Thinking, 159–71.
———. 2007. “Coherence, Truth, and the Development of Scientific Knowledge.” Philosophy of Science 74: 28–47.
Thagard, Paul, and Abninder Litt. 2008. “Models of Scientific Explanation.” In The Cambridge Handbook of Computational Psychology. Cambridge: Cambridge University Press.
Thagard, Paul, and Jing Zhu. 2003. “Acupuncture, Incommensurability, and Conceptual Change.” Intentional Conceptual Change, 79–102.
Thurner, Stefan, and Rudolf Hanel. 2010. “Peer-Review in a World with Rational Scientists: Toward Selection of the Average.”
Vanberg, Viktor J. 2004. “The Rationality Postulate in Economics: Its Ambiguity, Its Deficiency and Its Evolutionary Alternative.” Journal of Economic Methodology 11: 171–29.
Vazire, Simine. 2017. “Our Obsession with Eminence Warps Research.” Nature News 547 (7661): 7.
Wible, James R. 1998. Economics of Science. Routledge.
Wilson, Edward O. 1998. Consilience: The Unity of Knowledge. Alfred A. Knopf.
Wolpert, David H. 2008. “Physical Limits of Inference.” Physica D: Nonlinear Phenomena, Novel Computing Paradigms: Quo Vadis?, 237 (9): 1257–81.
———. 2018. “Theories of Knowledge and Theories of Everything.” In The Map and the Territory: Exploring the Foundations of Science, Thought and Reality, 165. Cham: Springer.
Yarkoni, Tal. 2019. “The Generalizability Crisis.” Preprint. PsyArXiv.
Zimmer, Carl. 2020. “How You Should Read Coronavirus Studies, or Any Science Paper.” The New York Times, June 1, 2020, sec. Science.

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.