Distributed sensing, swarm sensing, adaptive social learning

Is this is a real field separate from all the things that looks similar to it? e.g.probability collectives (are they a thing?) and the nature-inspired algorithms people get disturbingly enthusiastic about (ant colonies, particle swarms, that one based on choirsโ€ฆ), distributed consistency, and reliability engineering (Byzantine generals etc), โ€ฆand quorum sensing? How about that?

Local versus global design

Iโ€™m particular interested in the constraints on what global organising can be done using local information. There are formal approaches to this, e.g. H. Wang and Rubenstein (2020) and more casual, fun ones like Mordvintsev et al. (2020).

Incentive design

If your network has autonomous agents that need to cooperate, how do you design their private utility? Although this looks a little bit like collective decisions, I am thinking of more incentive design-oriented questions. When we say โ€œmulti agent systemsโ€ there is usually a presumption that the individual agents are fairly simple, not whole human beings. Special case: flocking. The barriers betwixt these are permeable.

Graph topology

If the graph topology of connections is not 1:N but something more complicated, what happens to learnability? What if you need to discover something controlling for graph topology? I have arbitrarily filed that under inference on social graphs.

As metaphor for human systems

See wisdom of crowds versus groupthink, or possible weaponized social media.



Acemoglu, Daron, and Asuman Ozdaglar. 2011. โ€œOpinion Dynamics and Learning in Social Networks.โ€ Dynamic Games and Applications 1 (1): 3โ€“49.
Achlioptas, Dimitris, Aaron Clauset, David Kempe, and Cristopher Moore. 2005. โ€œOn the Bias of Traceroute Sampling: Or, Power-Law Degree Distributions in Regular Graphs.โ€ In Proceedings of the Thirty-Seventh Annual ACM Symposium on Theory of Computing, 694โ€“703. STOC โ€™05. New York, NY, USA: ACM.
Akbarpour, Mohammad, and Matthew O. Jackson. 2018. โ€œDiffusion in Networks and the Virtue of Burstiness.โ€ Proceedings of the National Academy of Sciences 115 (30): E6996โ€“7004.
Akyildiz, Ian F., Weilian Su, Yogesh Sankarasubramaniam, and Erdal Cayirci. 2002. โ€œA Survey on Sensor Networks.โ€ Communications Magazine, IEEE 40 (8): 102โ€“14.
Barfoot, Timothy D. 2020. โ€œFundamental Linear Algebra Problem of Gaussian Inference.โ€ arXiv.
Bianchi, P., and J. Jakubowicz. 2013. โ€œConvergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization.โ€ IEEE Transactions on Automatic Control 58 (2): 391โ€“405.
Bieniawski, Stefan, and David H. Wolpert. 2004. โ€œAdaptive, Distributed Control of Constrained Multi-Agent Systems.โ€ In Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems-Volume 3, 4:1230โ€“31. IEEE Computer Society.
Bishop, Adrian N., and Arnaud Doucet. 2014. โ€œDistributed Nonlinear Consensus in the Space of Probability Measures.โ€ IFAC Proceedings Volumes, 19th IFAC World Congress, 47 (3): 8662โ€“68.
Cattivelli, Federico S., Cassio G. Lopes, and Ali H. Sayed. 2008. โ€œDiffusion Recursive Least-Squares for Distributed Estimation over Adaptive Networks.โ€ IEEE Transactions on Signal Processing 56 (5): 1865โ€“77.
Cattivelli, Federico S., and Ali H. Sayed. 2009. โ€œDiffusion LMS Strategies for Distributed Estimation.โ€ IEEE Transactions on Signal Processing 58 (3): 1035โ€“48.
โ€”โ€”โ€”. 2010. โ€œDiffusion Strategies for Distributed Kalman Filtering and Smoothing.โ€ IEEE Transactions on Automatic Control 55 (9): 2069โ€“84.
Chen, Jianshu, and Ali H. Sayed. 2012. โ€œDiffusion Adaptation Strategies for Distributed Optimization and Learning over Networks.โ€ IEEE Transactions on Signal Processing 60 (8): 4289โ€“4305.
Codenotti, Bruno, and Kasturi Varadarajan. 2004. โ€œEfficient Computation of Equilibrium Prices for Markets with Leontief Utilities.โ€ In ICALP, 371โ€“82. Springer.
Degroot, Morris H. 1974. โ€œReaching a Consensus.โ€ Journal of the American Statistical Association 69 (345): 118โ€“21.
Deng, Xiaotie, Christos Papadimitriou, and Shmuel Safra. 2002. โ€œOn the Complexity of Equilibria.โ€ In Proceedings of the Thiry-Fourth Annual ACM Symposium on Theory of Computing, 67โ€“71. STOC โ€™02. New York, NY, USA: ACM.
Di Lorenzo, Paolo, and Ali H. Sayed. 2013. โ€œSparse Distributed Learning Based on Diffusion Adaptation.โ€ IEEE Transactions on Signal Processing 61 (6): 1419โ€“33.
Freeman, R.A., Peng Yang, and K.M. Lynch. 2006. โ€œStability and Convergence Properties of Dynamic Average Consensus Estimators.โ€ In 2006 45th IEEE Conference on Decision and Control, 338โ€“43. San Diego, CA, USA: IEEE.
Galesic, Mirta, Daniel Barkoczi, Andrew Berdahl, Dora Biro, Giuseppe Carbone, Ilaria Giannoccaro, Robert Goldstone, et al. 2022. โ€œBeyond Collective Intelligence: Collective Adaptation.โ€ SocArXiv.
Galesic, Mirta, Daniel Barkoczi, and Konstantinos Katsikopoulos. 2018. โ€œSmaller Crowds Outperform Larger Crowds and Individuals in Realistic Task Conditions.โ€ Decision 5 (1): 1โ€“15.
Ha, David, and Yujin Tang. 2022. โ€œCollective Intelligence for Deep Learning: A Survey of Recent Developments.โ€ Collective Intelligence 1 (1): 26339137221114874.
Ho, Yu-Chi, M. Kastner, and E. Wong. 1978. โ€œTeams, Signaling, and Information Theory.โ€ IEEE Transactions on Automatic Control 23 (2): 305โ€“12.
Hong, Lu, and Scott E. Page. 2004. โ€œGroups of Diverse Problem Solvers Can Outperform Groups of High-Ability Problem Solvers.โ€ Proceedings of the National Academy of Sciences 101 (46): 16385โ€“89.
Ikeda, M. 1989. โ€œDecentralized Control of Large Scale Systems.โ€ In Three Decades of Mathematical System Theory: A Collection of Surveys at the Occasion of the 50th Birthday of Jan C. Willems, edited by Hendrik Nijmeijer and Johannes M. Schumacher, 219โ€“42. Lecture Notes in Control and Information Sciences. Berlin, Heidelberg: Springer.
Kayaalp, Mert, Virginia Bordignon, Stefan Vlaski, and Ali H. Sayed. 2021. โ€œHidden Markov Modeling over Graphs.โ€ arXiv:2111.13626 [Cs, Eess], November.
Lalitha, Anusha, Tara Javidi, and Anand Sarwate. 2014. โ€œSocial Learning and Distributed Hypothesis Testing.โ€ arXiv:1410.4307 [Cs, Math, Stat], October.
Linial, Nathan. 1994. โ€œChapter 38 Game-Theoretic Aspects of Computing.โ€ In Handbook of Game Theory with Economic Applications, 2:1339โ€“95. Elsevier.
Lopes, Cassio G., and Ali H. Sayed. 2007. โ€œIncremental Adaptive Strategies over Distributed Networks.โ€ IEEE Transactions on Signal Processing 55 (8): 4064โ€“77.
โ€”โ€”โ€”. 2008. โ€œDiffusion Least-Mean Squares over Adaptive Networks: Formulation and Performance Analysis.โ€ IEEE Transactions on Signal Processing 56 (7): 3122โ€“36.
Mann, Richard P., and Dirk Helbing. 2016. โ€œMinorities Report: Optimal Incentives for Collective Intelligence.โ€ arXiv:1611.03899 [Cs, Math, Stat], November.
Mateo, David, Nikolaj Horsevad, Vahid Hassani, Mohammadreza Chamanbaz, and Roland Bouffanais. 2019. โ€œOptimal Network Topology for Responsive Collective Behavior.โ€ Science Advances 5 (4).
Mordvintsev, Alexander, Ettore Randazzo, Eyvind Niklasson, and Michael Levin. 2020. โ€œGrowing Neural Cellular Automata.โ€ Distill 5 (2): e23.
Navlakha, Saket, and Ziv Bar-Joseph. 2014. โ€œDistributed Information Processing in Biological and Computational Systems.โ€ Communications of the ACM 58 (1): 94โ€“102.
Ohsawa, Shohei. 2021. โ€œUnbiased Self-Play.โ€ arXiv:2106.03007 [Cs, Econ, Stat], June.
Olfati-Saber, R. 2006. โ€œFlocking for Multi-Agent Dynamic Systems: Algorithms and Theory.โ€ Automatic Control, IEEE Transactions on 51 (3): 401โ€“20.
Olfati-Saber, R. 2005. โ€œDistributed Kalman Filter with Embedded Consensus Filters.โ€ In 44th IEEE Conference on Decision and Control, 2005 and 2005 European Control Conference. CDC-ECC โ€™05, 8179โ€“84. Seville, Spain: IEEE.
Olfati-Saber, Reza, Elisa Franco, Emilio Frazzoli, and Je. S. Shamma. 2006. โ€œBelief Consensus and Distributed Hypothesis Testing in Sensor Networks.โ€ In Networked Embedded Sensing and Control, edited by Panos J. Antsaklis and Paulo Tabuada, 331:169โ€“82. Berlin/Heidelberg: Springer-Verlag.
Olfati-Saber, R., J.A. Fax, and R.M. Murray. 2007. โ€œConsensus and Cooperation in Networked Multi-Agent Systems.โ€ Proceedings of the IEEE 95 (1): 215โ€“33.
Ren, W, and R W Beard. 2005. โ€œConsensus Seeking in Multiagent Systems Under Dynamically Changing Interaction Topologies.โ€ Automatic Control, IEEE Transactions on 50 (5): 655โ€“61.
Samuelson, Larry. 2001. โ€œAnalogies, Adaptation, and Anomalies.โ€ Journal of Economic Theory 97 (2): 320โ€“66.
Sayed, Ali. 2014. โ€œAdaptation, Learning, and Optimization over Networks.โ€ Foundations and Trendsยฎ in Machine Learning 7 (4-5): 311โ€“801.
Sayed, Ali H. 2014. โ€œAdaptive Networks.โ€ Proceedings of the IEEE 102 (4): 460โ€“97.
Spanos, Demetri P., Reza Olfati-Saber, and Richard M. Murray. 2005. โ€œDynamic Consensus on Mobile Networks.โ€ In IFAC World Congress, 1โ€“6. Citeseer.
Stiglitz, Joseph E. 2006. โ€œThe Contributions of the Economics of Information to Twentieth Century Economics.โ€ The Quarterly Journal of Economics 115 (4).
Tumer, Kagan, and David H Wolpert. 2004. โ€œCoordination in Large Collectives- Chapter 1.โ€ In.
Wang, Hanlin, and Michael Rubenstein. 2020. โ€œShape Formation in Homogeneous Swarms Using Local Task Swapping.โ€ IEEE Transactions on Robotics, 1โ€“16.
Wang, Shengdi, and Armin Dekorsy. 2020. โ€œA Factor Graph-Based Distributed Consensus Kalman Filter.โ€ IEEE Signal Processing Letters 27: 2039โ€“43.
Wolpert, David H. 2006a. โ€œAdvances in Distributed Optimization Using Probability Collectives.โ€ Advances in Complex Systems 9.
โ€”โ€”โ€”. 2006b. โ€œInformation Theory โ€” The Bridge Connecting Bounded Rational Game Theory and Statistical Physics.โ€ In Complex Engineered Systems, 262โ€“90. Understanding Complex Systems. Springer Berlin Heidelberg.
Wolpert, David H, Stefan R Bieniawski, and Dev G Rajnarayan. 2011. โ€œProbability Collectives in Optimization.โ€
Wolpert, David H, and John W Lawson. 2002. โ€œDesigning Agent Collectives for Systems with Markovian Dynamics.โ€ In, 1066โ€“73.
Wolpert, David H., and Kagan Tumer. 1999. โ€œAn Introduction to Collective Intelligence.โ€ arXiv:cs/9908014, August.
Wolpert, David H, Kevin R Wheeler, and Kagan Tumer. 1999. โ€œGeneral Principles of Learning-Based Multi-Agent Systems.โ€ In, 77โ€“83.
โ€”โ€”โ€”. 2000. โ€œCollective Intelligence for Control of Distributed Dynamical Systems.โ€ EPL (Europhysics Letters) 49: 708.
Ye, Yinyu. 2008. โ€œA Path to the Arrowโ€“Debreu Competitive Market Equilibrium.โ€ Mathematical Programming 111 (1-2): 315โ€“48.
Zhang, Rui, and Quanyan Zhu. 2017. โ€œGame-Theoretic Design of Secure and Resilient Distributed Support Vector Machines with Adversaries.โ€ arXiv:1710.04677 [Cs, Stat], October.
Zhao, Xiaochuan, and Ali H. Sayed. 2014. โ€œAsynchronous Adaptation and Learning over Networks โ€” Part I: Modeling and Stability Analysis.โ€ arXiv:1312.5434 [Cs, Math], December.
Zivojevic, Dino, Muhamed Delalic, Darijo Raca, Dejan Vukobratovic, and Mirsad Cosovic. 2021. โ€œDistributed Weighted Least-Squares and Gaussian Belief Propagation: An Integrated Approach.โ€ Preprint.

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.