Biological basis of language
Neurology, evolution and ecology of our memes
January 11, 2018 — September 16, 2021
1 Neurology of language
Dan Stowell summarises a neural basis for recursive syntax:
For decades, Noam Chomsky and colleagues have famously been developing and advocating a “minimalist” (Bolhuis et al. 2014) idea about the machinery our brain uses to process language. […] They propose that not much machinery is needed, and one of the key components is a “merge” operation that the brain uses in composing and decomposing grammatical structures.
Then yesterday I was reading this introduction to embeddings in artificial neural networks and NLP, and I read the following:
“Models like [this] are powerful, but they have an unfortunate limitation: they can only have a fixed number of inputs. We can overcome this by adding an association module, A, which will take two word or phrase representations and merge them.” (Bottou 2011)
2 Analogy with artificial neural networks
TBD
3 Evolution of language
TBD
4 Computational plausibility
See syntax.
5 Meaning
See semantics.
6 Incoming
“They’re using phrase-structure grammar, long-distance dependencies. FLN recursion, at least four levels deep and I see no reason why it won’t go deeper with continued contact. […] It doesn’t have a clue what I’m saying.”
“What?”
“It doesn’t even have a clue what it’s saying back,” she added.
Peter Watts, Blindsight