World models arising in foundation models.

December 20, 2024 — December 20, 2024

approximation
Bayes
generative
language
machine learning
meta learning
Monte Carlo
neural nets
NLP
optimization
probabilistic algorithms
probability
statistics
stringology
time series
Figure 1

Placeholder, for notes on what kind of world models reside in neural nets.

1 Incoming

NeurIPS 2023 Tutorial: Language Models meet World Models

2 References

Basu, Grayson, Morrison, et al. 2024. Understanding Information Storage and Transfer in Multi-Modal Large Language Models.”
Ge, Huang, Zhou, et al. 2024. WorldGPT: Empowering LLM as Multimodal World Model.” In Proceedings of the 32nd ACM International Conference on Multimedia. MM ’24.
Hao, Gu, Ma, et al. 2023. Reasoning with Language Model Is Planning with World Model.”
Hu, and Shu. 2023. Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning.”
Wong, Grand, Lew, et al. 2023. From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought.”
Yildirim, and Paul. 2024. From Task Structures to World Models: What Do LLMs Know? Trends in Cognitive Sciences.