At social brain I wonder how our brains behave socially, and evolutionarily.
Here I wonder if consciousness is intrinsically social, and whether non social intelligences are a problem for consciousness. What ethics will execute on their moral wetware?
…is consciousness that good anyway?
Loss functions versus survival functions
TBC
Incoming
Neural Annealing: Toward a Neural Theory of Everything.
Predictive Coding has been Unified with Backpropagation, concerning Millidge, Tschantz, and Buckley (2020). I have not read the article or the explanation properly, but at first glance it indicates that perhaps I do not understand this area properly. The assertion, skim-read, seems to be that predictive coding, which I imagined was some form of variational inference, can approximate minimum loss learning by backpropagation in some sense. While not precisely trivial, this would seem like well-trodden ground— unless I have failed to understand how they are using the terms, which seems likely. TBC.
- Gradient Dissent, a list of reasons that large backpropagation-trained networks might be worrisome. There are some interesting points in there, and some hyperbole. Also: If it were true that there are externalities from backprop networks (i.e. that they are a kind of methodological pollution that produces private benefits but public costs) then what kind of mechanisms should be applied to disincentivise them?
- C&C Against Predictive Optimization
- Gordon Brander, Coevolution creates living complexity
References
Acemoglu, Daron, and Asuman Ozdaglar. 2011. “Opinion Dynamics and Learning in Social Networks.” Dynamic Games and Applications 1 (1): 3–49.
Aktipis, Athena. 2016. “Principles of Cooperation Across Systems: From Human Sharing to Multicellularity and Cancer.” Evolutionary Applications 9 (1): 17–36.
Altaner, Bernhard. 2017. “Nonequilibrium Thermodynamics and Information Theory: Basic Concepts and Relaxing Dynamics*.” Journal of Physics A: Mathematical and Theoretical 50 (45): 454001.
Axelrod, Robert M. 1984. The evolution of cooperation. New York: Basic books.
Axelrod, Robert, and William D. Hamilton. 1981. “The Evolution of Cooperation.” Science, New Series, 211 (4489): 1390–96.
Beaulieu, Shawn, Lapo Frati, Thomas Miconi, Joel Lehman, Kenneth O. Stanley, Jeff Clune, and Nick Cheney. 2020. “Learning to Continually Learn.” arXiv.
Beretta, Gian Paolo. 2020. “The Fourth Law of Thermodynamics: Steepest Entropy Ascent.” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 378 (2170): 20190168.
Bieniawski, Stefan, and David H. Wolpert. 2004. “Adaptive, Distributed Control of Constrained Multi-Agent Systems.” In Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems-Volume 3, 4:1230–31. IEEE Computer Society.
Bowles, Samuel, Jung-Kyoo Choi, and Astrid Hopfensitz. 2003. “The Co-Evolution of Individual Behaviors and Social Institutions.” Journal of Theoretical Biology 223 (2): 135–47.
Boyd, A. B., J. P. Crutchfield, and M. Gu. 2020. “Thermodynamic Machine Learning Through Maximum Work Production,” June.
Boyd, Robert, and Peter J Richerson. 1999. “Complex Societies: The Evolutionary Origins of a Crude Superorganism.” Human Nature 10: 253.
Fletcher, Jeffrey A., and Martin Zwick. 2007. “The evolution of altruism: game theory in multilevel selection and inclusive fitness.” Journal of Theoretical Biology 245 (1): 26–36.
Galesic, Mirta, Daniel Barkoczi, Andrew Berdahl, Dora Biro, Giuseppe Carbone, Ilaria Giannoccaro, Robert Goldstone, et al. 2022. “Beyond Collective Intelligence: Collective Adaptation.” SocArXiv.
Gintis, Herbert, Samuel Bowles, Robert Boyd, and Ernst Fehr. 2003. “Explaining Altruistic Behavior in Humans.” Evolution and Human Behavior 24 (3): 153–72.
Gopnik, Alison. 2020. “Childhood as a Solution to Explore–Exploit Tensions.” Philosophical Transactions of the Royal Society B: Biological Sciences 375 (1803): 20190502.
Ha, David, and Yujin Tang. 2022. “Collective Intelligence for Deep Learning: A Survey of Recent Developments.” Collective Intelligence 1 (1): 26339137221114874.
Harper, Marc. 2009. “The Replicator Equation as an Inference Dynamic,” November.
Hasegawa, Yoshihiko, and Tan Van Vu. 2019. “Uncertainty Relations in Stochastic Processes: An Information Inequality Approach.” Physical Review E 99 (6): 062126.
Henrich, Joseph, and Robert Boyd. 1998. “The Evolution of Conformist Transmission and the Emergence of Between-Group Differences.” Evolution and Human Behavior 19 (4): 215–41.
Henrich, Joseph, and Francisco J. Gil-White. 2001. “The Evolution of Prestige: Freely Conferred Deference as a Mechanism for Enhancing the Benefits of Cultural Transmission.” Evolution and Human Behavior 22 (3): 165–96.
Hertz, Uri, Margaux Romand-Monnier, Konstantina Kyriakopoulou, and Bahador Bahrami. 2016. “Social influence protects collective decision making from equality bias.” Journal of Experimental Psychology. Human Perception and Performance 42 (2): 164–72.
Hetzer, Moritz, and Didier Sornette. 2009. “Other-Regarding Preferences and Altruistic Punishment: A Darwinian Perspective.” SSRN Scholarly Paper ID 1468517. Rochester, NY: Social Science Research Network.
Hoelzemann, Johannes, and Nicolas Klein. 2021. “Bandits in the Lab.” Quantitative Economics 12 (3): 1021–51.
Hunt, Tam. n.d. “The ‘Easy Part’ of the Hard Problem: A Resonance Theory of Consciousness.” Authorea, Inc.
Judson, Olivia P. 2017. “The Energy Expansions of Evolution.” Nature Ecology & Evolution 1 (April): 0138.
Kolchinsky, Artemy, and David H. Wolpert. 2018. “Semantic Information, Autonomous Agency, and Nonequilibrium Statistical Physics,” June.
Krakauer, David C., Karen M. Page, and Douglas H. Erwin. 2009. “Diversity, Dilemmas, and Monopolies of Niche Construction.” The American Naturalist 173 (1): 26–40.
Krzakala, Florent, Lenka Zdeborova, Maria Chiara Angelini, and Francesco Caltagirone. n.d. “Statistical Physics of Inference and Bayesian Estimation,” 44.
Lang, Alex H., Charles K. Fisher, Thierry Mora, and Pankaj Mehta. 2014. “Thermodynamics of Statistical Inference by Cells.” Physical Review Letters 113 (14).
Lehman, Joel, and Kenneth O. Stanley. 2011. “Abandoning Objectives: Evolution Through the Search for Novelty Alone.” Evolutionary Computation 19 (2): 189–223.
———. 2013. “Evolvability Is Inevitable: Increasing Evolvability Without the Pressure to Adapt.” PLoS ONE 8 (4): e62186.
Mandelbrot, Benoit. 1962. “The Role of Sufficiency and of Estimation in Thermodynamics.” The Annals of Mathematical Statistics 33 (3): 1021–38.
McElreath, Richard, and Robert Boyd. 2007. Mathematical Models of Social Evolution: A Guide for the Perplexed. University Of Chicago Press.
Mercier, Hugo, and Dan Sperber. 2011a. “Argumentation: Its Adaptiveness and Efficacy.” Behavioral and Brain Sciences 34 (2): 94–111.
———. 2011b. “Why Do Humans Reason? Arguments for an Argumentative Theory.” Behavioral and Brain Sciences 34 (2): 57–74.
———. 2017. The Enigma of Reason. Harvard University Press.
Millidge, Beren, Alexander Tschantz, and Christopher L. Buckley. 2020. “Predictive Coding Approximates Backprop Along Arbitrary Computation Graphs.” arXiv:2006.04182 [Cs], October.
Moral Sentiments and Material Interests: The Foundations of Cooperation in Economic Life. 2006. The MIT Press.
Morowitz, Harold, and D Eric Smith. 2007. “Energy Flow and the Organization of Life.” Complexity 13 (1): 51–59.
Nowak, Martin A. 2006. “Five Rules for the Evolution of Cooperation.” Science 314 (5805): 1560–63.
O’Connor, Cailin. 2017. “Evolving to Generalize: Trading Precision for Speed.” British Journal for the Philosophy of Science 68 (2).
Odum, Howard T. 1973. “Energy, Ecology, and Economics.” Ambio 2 (6): 220–27.
Omohundro, Stephen M. 2008. “The Basic AI Drives.” In Proceedings of the 2008 Conference on Artificial General Intelligence 2008: Proceedings of the First AGI Conference, 483–92. NLD: IOS Press.
Perunov, Nikolay, Robert A. Marsland, and Jeremy L. England. 2016. “Statistical Physics of Adaptation.” Physical Review X 6 (2): 021036.
Poole, Ben, Subhaneil Lahiri, Maithreyi Raghu, Jascha Sohl-Dickstein, and Surya Ganguli. 2016. “Exponential Expressivity in Deep Neural Networks Through Transient Chaos.” In Advances in Neural Information Processing Systems 29, edited by D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett, 3360–68. Curran Associates, Inc.
Ricotta, Carlo, and Laszlo Szeidl. 2006. “Towards a Unifying Approach to Diversity Measures: Bridging the Gap Between the Shannon Entropy and Rao’s Quadratic Index.” Theoretical Population Biology 70 (3): 237–43.
Ringstrom, Thomas J. 2022. “Reward Is Not Necessary: How to Create a Compositional Self-Preserving Agent for Life-Long Learning.” arXiv.
Schneider, J J, and James J Kay. 1994. “Life as a Manifestation of the Second Law of Thermodynamics.” Mathematical and Computer Modelling 19 (6-8): 25–48.
Shwartz-Ziv, Ravid, and Naftali Tishby. 2017. “Opening the Black Box of Deep Neural Networks via Information.” arXiv:1703.00810 [Cs], March.
Smith, D Eric. 2008. “Thermodynamics of Natural Selection III: Landauer’s Principle in Computation and Chemistry.” Journal of Theoretical Biology 252 (2): 213–20.
Sperber, Dan, and Hugo Mercier. 2012. “Reasoning as a Social Competence.” In Collective Wisdom, edited by Hélène Landemore and Jon Elster, 1st ed., 368–92. Cambridge University Press.
Stiglitz, Joseph E. 2006. “The Contributions of the Economics of Information to Twentieth Century Economics.” The Quarterly Journal of Economics 115 (4).
Still, Susanne, David A. Sivak, Anthony J. Bell, and Gavin E. Crooks. 2012. “Thermodynamics of Prediction.” Physical Review Letters 109 (12): 120604.
Székely, Gábor J., and Maria L. Rizzo. 2017. “The Energy of Data.” Annual Review of Statistics and Its Application 4 (1): 447–79.
Thagard, Paul. 1997. “Collaborative Knowledge.” Noûs 31 (2): 242–61.
Ulanowicz, Robert E., and Luis G. Abarca-Arenas. 1997. “An Informational Synthesis of Ecosystem Structure and Function.” Ecological Modelling 95 (1): 1–10.
Ulanowicz, Robert E., Sally J. Goerner, Bernard Lietaer, and Rocio Gomez. 2009. “Quantifying Sustainability: Resilience, Efficiency and the Return of Information Theory.” Ecological Complexity 6 (1): 27–36.
Weng, L, A Flammini, A Vespignani, F Menczer, L Weng, A Flammini, A Vespignani, and F Menczer. 2012. “Competition Among Memes in a World with Limited Attention.” Scientific Reports 2.
Wolpert, David. 2017. “Constraints on Physical Reality Arising from a Formalization of Knowledge,” November.
Wolpert, David H. 2006a. “Advances in Distributed Optimization Using Probability Collectives.” Advances in Complex Systems 9.
———. 2006b. “Information Theory — The Bridge Connecting Bounded Rational Game Theory and Statistical Physics.” In Complex Engineered Systems, 262–90. Understanding Complex Systems. Springer Berlin Heidelberg.
Wolpert, David H. 2008. “Physical Limits of Inference.” Physica D: Nonlinear Phenomena, Novel Computing Paradigms: Quo Vadis?, 237 (9): 1257–81.
———. 2016. “The Free Energy Requirements of Biological Organisms; Implications for Evolution,” March.
———. 2018. “Theories of Knowledge and Theories of Everything.” In The Map and the Territory: Exploring the Foundations of Science, Thought and Reality, 165. Cham: Springer.
———. 2019. “Stochastic Thermodynamics of Computation,” May.
———. 2021. “Fluctuation Theorems for Multiple Co-Evolving Systems.” arXiv:2003.11144 [Cond-Mat], April.
Wolpert, David H, Stefan R Bieniawski, and Dev G Rajnarayan. 2011. “Probability Collectives in Optimization.”
Wolpert, David H., and Kagan Tumer. 1999. “An Introduction to Collective Intelligence.” arXiv:cs/9908014, August.
Wolpert, David H, Kevin R Wheeler, and Kagan Tumer. 1999. “General Principles of Learning-Based Multi-Agent Systems.” In, 77–83.
Zdeborová, Lenka, and Florent Krzakala. 2016. “Statistical Physics of Inference: Thresholds and Algorithms.” Advances in Physics 65 (5): 453–552.
No comments yet. Why not leave one?