Gradient steps to an ecology of mind

The best as enemy of the good



At social brain I wonder how our brains behave socially, and evolutionarily.

Here I wonder if consciousness is intrinsically social, and whether non social intelligences are a problem for consciousness. What ethics will execute on their moral wetware?

…is consciousness that good anyway?

Loss functions versus survival functions

TBC

Incoming

Neural Annealing: Toward a Neural Theory of Everything.

Predictive Coding has been Unified with Backpropagation, concerning Millidge, Tschantz, and Buckley (2020). I have not read the article or the explanation properly, but at first glance it indicates that perhaps I do not understand this area properly. The assertion, skim-read, seems to be that predictive coding, which I imagined was some form of variational inference, can approximate minimum loss learning by backpropagation in some sense. While not precisely trivial, this would seem like well-trodden groundβ€” unless I have failed to understand how they are using the terms, which seems likely. TBC.

  • Gradient Dissent, a list of reasons that large backpropagation-trained networks might be worrisome. There are some interesting points in there, and some hyperbole. Also: If it were true that there are externalities from backprop networks (i.e. that they are a kind of methodological pollution that produces private benefits but public costs) then what kind of mechanisms should be applied to disincentivise them?
  • C&C Against Predictive Optimization

References

Acemoglu, Daron, and Asuman Ozdaglar. 2011. β€œOpinion Dynamics and Learning in Social Networks.” Dynamic Games and Applications 1 (1): 3–49.
Aktipis, Athena. 2016. β€œPrinciples of Cooperation Across Systems: From Human Sharing to Multicellularity and Cancer.” Evolutionary Applications 9 (1): 17–36.
Altaner, Bernhard. 2017. β€œNonequilibrium Thermodynamics and Information Theory: Basic Concepts and Relaxing Dynamics*.” Journal of Physics A: Mathematical and Theoretical 50 (45): 454001.
Axelrod, Robert M. 1984. The evolution of cooperation. New York: Basic books.
Axelrod, Robert, and William D. Hamilton. 1981. β€œThe Evolution of Cooperation.” Science, New Series, 211 (4489): 1390–96.
Beaulieu, Shawn, Lapo Frati, Thomas Miconi, Joel Lehman, Kenneth O. Stanley, Jeff Clune, and Nick Cheney. 2020. β€œLearning to Continually Learn.” arXiv.
Beretta, Gian Paolo. 2020. β€œThe Fourth Law of Thermodynamics: Steepest Entropy Ascent.” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 378 (2170): 20190168.
Bieniawski, Stefan, and David H. Wolpert. 2004. β€œAdaptive, Distributed Control of Constrained Multi-Agent Systems.” In Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems-Volume 3, 4:1230–31. IEEE Computer Society.
Bowles, Samuel, Jung-Kyoo Choi, and Astrid Hopfensitz. 2003. β€œThe Co-Evolution of Individual Behaviors and Social Institutions.” Journal of Theoretical Biology 223 (2): 135–47.
Boyd, A. B., J. P. Crutchfield, and M. Gu. 2020. β€œThermodynamic Machine Learning Through Maximum Work Production,” June.
Boyd, Robert, and Peter J Richerson. 1999. β€œComplex Societies: The Evolutionary Origins of a Crude Superorganism.” Human Nature 10: 253.
Fletcher, Jeffrey A., and Martin Zwick. 2007. β€œThe evolution of altruism: game theory in multilevel selection and inclusive fitness.” Journal of Theoretical Biology 245 (1): 26–36.
Galesic, Mirta, Daniel Barkoczi, Andrew Berdahl, Dora Biro, Giuseppe Carbone, Ilaria Giannoccaro, Robert Goldstone, et al. 2022. β€œBeyond Collective Intelligence: Collective Adaptation.” SocArXiv.
Gintis, Herbert, Samuel Bowles, Robert Boyd, and Ernst Fehr. 2003. β€œExplaining Altruistic Behavior in Humans.” Evolution and Human Behavior 24 (3): 153–72.
Gopnik, Alison. 2020. β€œChildhood as a Solution to Explore–Exploit Tensions.” Philosophical Transactions of the Royal Society B: Biological Sciences 375 (1803): 20190502.
Ha, David, and Yujin Tang. 2022. β€œCollective Intelligence for Deep Learning: A Survey of Recent Developments.” Collective Intelligence 1 (1): 26339137221114874.
Harper, Marc. 2009. β€œThe Replicator Equation as an Inference Dynamic,” November.
Hasegawa, Yoshihiko, and Tan Van Vu. 2019. β€œUncertainty Relations in Stochastic Processes: An Information Inequality Approach.” Physical Review E 99 (6): 062126.
Henrich, Joseph, and Robert Boyd. 1998. β€œThe Evolution of Conformist Transmission and the Emergence of Between-Group Differences.” Evolution and Human Behavior 19 (4): 215–41.
Henrich, Joseph, and Francisco J. Gil-White. 2001. β€œThe Evolution of Prestige: Freely Conferred Deference as a Mechanism for Enhancing the Benefits of Cultural Transmission.” Evolution and Human Behavior 22 (3): 165–96.
Hertz, Uri, Margaux Romand-Monnier, Konstantina Kyriakopoulou, and Bahador Bahrami. 2016. β€œSocial influence protects collective decision making from equality bias.” Journal of Experimental Psychology. Human Perception and Performance 42 (2): 164–72.
Hetzer, Moritz, and Didier Sornette. 2009. β€œOther-Regarding Preferences and Altruistic Punishment: A Darwinian Perspective.” SSRN Scholarly Paper ID 1468517. Rochester, NY: Social Science Research Network.
Hoelzemann, Johannes, and Nicolas Klein. 2021. β€œBandits in the Lab.” Quantitative Economics 12 (3): 1021–51.
Hunt, Tam. n.d. β€œThe β€˜Easy Part’ of the Hard Problem: A Resonance Theory of Consciousness.” Authorea, Inc.
Judson, Olivia P. 2017. β€œThe Energy Expansions of Evolution.” Nature Ecology & Evolution 1 (April): 0138.
Kolchinsky, Artemy, and David H. Wolpert. 2018. β€œSemantic Information, Autonomous Agency, and Nonequilibrium Statistical Physics,” June.
Krakauer, DavidΒ C., KarenΒ M. Page, and DouglasΒ H. Erwin. 2009. β€œDiversity, Dilemmas, and Monopolies of Niche Construction.” The American Naturalist 173 (1): 26–40.
Krzakala, Florent, Lenka Zdeborova, Maria Chiara Angelini, and Francesco Caltagirone. n.d. β€œStatistical Physics of Inference and Bayesian Estimation,” 44.
Lang, Alex H., Charles K. Fisher, Thierry Mora, and Pankaj Mehta. 2014. β€œThermodynamics of Statistical Inference by Cells.” Physical Review Letters 113 (14).
Lehman, Joel, and Kenneth O. Stanley. 2011. β€œAbandoning Objectives: Evolution Through the Search for Novelty Alone.” Evolutionary Computation 19 (2): 189–223.
β€”β€”β€”. 2013. β€œEvolvability Is Inevitable: Increasing Evolvability Without the Pressure to Adapt.” PLoS ONE 8 (4): e62186.
Mandelbrot, Benoit. 1962. β€œThe Role of Sufficiency and of Estimation in Thermodynamics.” The Annals of Mathematical Statistics 33 (3): 1021–38.
McElreath, Richard, and Robert Boyd. 2007. Mathematical Models of Social Evolution: A Guide for the Perplexed. University Of Chicago Press.
Mercier, Hugo, and Dan Sperber. 2011a. β€œArgumentation: Its Adaptiveness and Efficacy.” Behavioral and Brain Sciences 34 (2): 94–111.
β€”β€”β€”. 2011b. β€œWhy Do Humans Reason? Arguments for an Argumentative Theory.” Behavioral and Brain Sciences 34 (2): 57–74.
β€”β€”β€”. 2017. The Enigma of Reason. Harvard University Press.
Millidge, Beren, Alexander Tschantz, and Christopher L. Buckley. 2020. β€œPredictive Coding Approximates Backprop Along Arbitrary Computation Graphs.” arXiv:2006.04182 [Cs], October.
Moral Sentiments and Material Interests: The Foundations of Cooperation in Economic Life. 2006. The MIT Press.
Morowitz, Harold, and D Eric Smith. 2007. β€œEnergy Flow and the Organization of Life.” Complexity 13 (1): 51–59.
Nowak, Martin A. 2006. β€œFive Rules for the Evolution of Cooperation.” Science 314 (5805): 1560–63.
O’Connor, Cailin. 2017. β€œEvolving to Generalize: Trading Precision for Speed.” British Journal for the Philosophy of Science 68 (2).
Odum, Howard T. 1973. β€œEnergy, Ecology, and Economics.” Ambio 2 (6): 220–27.
Omohundro, Stephen M. 2008. β€œThe Basic AI Drives.” In Proceedings of the 2008 Conference on Artificial General Intelligence 2008: Proceedings of the First AGI Conference, 483–92. NLD: IOS Press.
Perunov, Nikolay, Robert A. Marsland, and Jeremy L. England. 2016. β€œStatistical Physics of Adaptation.” Physical Review X 6 (2): 021036.
Poole, Ben, Subhaneil Lahiri, Maithreyi Raghu, Jascha Sohl-Dickstein, and Surya Ganguli. 2016. β€œExponential Expressivity in Deep Neural Networks Through Transient Chaos.” In Advances in Neural Information Processing Systems 29, edited by D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett, 3360–68. Curran Associates, Inc.
Ricotta, Carlo, and Laszlo Szeidl. 2006. β€œTowards a Unifying Approach to Diversity Measures: Bridging the Gap Between the Shannon Entropy and Rao’s Quadratic Index.” Theoretical Population Biology 70 (3): 237–43.
Ringstrom, Thomas J. 2022. β€œReward Is Not Necessary: How to Create a Compositional Self-Preserving Agent for Life-Long Learning.” arXiv.
Schneider, J J, and James J Kay. 1994. β€œLife as a Manifestation of the Second Law of Thermodynamics.” Mathematical and Computer Modelling 19 (6-8): 25–48.
Shwartz-Ziv, Ravid, and Naftali Tishby. 2017. β€œOpening the Black Box of Deep Neural Networks via Information.” arXiv:1703.00810 [Cs], March.
Smith, D Eric. 2008. β€œThermodynamics of Natural Selection III: Landauer’s Principle in Computation and Chemistry.” Journal of Theoretical Biology 252 (2): 213–20.
Sperber, Dan, and Hugo Mercier. 2012. β€œReasoning as a Social Competence.” In Collective Wisdom, edited by HΓ©lΓ¨ne Landemore and Jon Elster, 1st ed., 368–92. Cambridge University Press.
Stiglitz, Joseph E. 2006. β€œThe Contributions of the Economics of Information to Twentieth Century Economics.” The Quarterly Journal of Economics 115 (4).
Still, Susanne, David A. Sivak, Anthony J. Bell, and Gavin E. Crooks. 2012. β€œThermodynamics of Prediction.” Physical Review Letters 109 (12): 120604.
SzΓ©kely, GΓ‘bor J., and Maria L. Rizzo. 2017. β€œThe Energy of Data.” Annual Review of Statistics and Its Application 4 (1): 447–79.
Thagard, Paul. 1997. β€œCollaborative Knowledge.” NoΓ»s 31 (2): 242–61.
Ulanowicz, Robert E., and Luis G. Abarca-Arenas. 1997. β€œAn Informational Synthesis of Ecosystem Structure and Function.” Ecological Modelling 95 (1): 1–10.
Ulanowicz, Robert E., Sally J. Goerner, Bernard Lietaer, and Rocio Gomez. 2009. β€œQuantifying Sustainability: Resilience, Efficiency and the Return of Information Theory.” Ecological Complexity 6 (1): 27–36.
Weng, L, A Flammini, A Vespignani, F Menczer, L Weng, A Flammini, A Vespignani, and F Menczer. 2012. β€œCompetition Among Memes in a World with Limited Attention.” Scientific Reports 2.
Wolpert, David. 2017. β€œConstraints on Physical Reality Arising from a Formalization of Knowledge,” November.
Wolpert, David H. 2006a. β€œAdvances in Distributed Optimization Using Probability Collectives.” Advances in Complex Systems 9.
β€”β€”β€”. 2006b. β€œInformation Theory β€” The Bridge Connecting Bounded Rational Game Theory and Statistical Physics.” In Complex Engineered Systems, 262–90. Understanding Complex Systems. Springer Berlin Heidelberg.
Wolpert, David H. 2008. β€œPhysical Limits of Inference.” Physica D: Nonlinear Phenomena, Novel Computing Paradigms: Quo Vadis?, 237 (9): 1257–81.
β€”β€”β€”. 2016. β€œThe Free Energy Requirements of Biological Organisms; Implications for Evolution,” March.
β€”β€”β€”. 2018. β€œTheories of Knowledge and Theories of Everything.” In The Map and the Territory: Exploring the Foundations of Science, Thought and Reality, 165. Cham: Springer.
β€”β€”β€”. 2019. β€œStochastic Thermodynamics of Computation,” May.
β€”β€”β€”. 2021. β€œFluctuation Theorems for Multiple Co-Evolving Systems.” arXiv:2003.11144 [Cond-Mat], April.
Wolpert, David H, Stefan R Bieniawski, and Dev G Rajnarayan. 2011. β€œProbability Collectives in Optimization.”
Wolpert, David H., and Kagan Tumer. 1999. β€œAn Introduction to Collective Intelligence.” arXiv:cs/9908014, August.
Wolpert, David H, Kevin R Wheeler, and Kagan Tumer. 1999. β€œGeneral Principles of Learning-Based Multi-Agent Systems.” In, 77–83.
ZdeborovΓ‘, Lenka, and Florent Krzakala. 2016. β€œStatistical Physics of Inference: Thresholds and Algorithms.” Advances in Physics 65 (5): 453–552.

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.