Center for the Study of Language and Information
Probabilistic Approaches to Linguistic Theory
9781684000791
9781684000807
Distributed for Center for the Study of Language and Information
Probabilistic Approaches to Linguistic Theory
A textbook exploring predictive modes of linguistic development and analysis.
During the last two decades, computational linguists, in concert with other researchers in AI, have turned to machine learning and statistical techniques to capture features of natural language and aspects of the learning process that are not easily accommodated in classical algebraic frameworks. These developments are producing a revolution in linguistics in which traditional symbolic systems are giving way to probabilistic and deep learning approaches. This collection features articles that provide background to these approaches, and their application in syntax, semantics, pragmatics, morphology, psycholinguistics, neurolinguistics, and dialogue modeling. Each chapter provides a self-contained introduction to the topic that it covers, making this volume accessible to graduate students and researchers in linguistics, NLP, AI, and cognitive science.
During the last two decades, computational linguists, in concert with other researchers in AI, have turned to machine learning and statistical techniques to capture features of natural language and aspects of the learning process that are not easily accommodated in classical algebraic frameworks. These developments are producing a revolution in linguistics in which traditional symbolic systems are giving way to probabilistic and deep learning approaches. This collection features articles that provide background to these approaches, and their application in syntax, semantics, pragmatics, morphology, psycholinguistics, neurolinguistics, and dialogue modeling. Each chapter provides a self-contained introduction to the topic that it covers, making this volume accessible to graduate students and researchers in linguistics, NLP, AI, and cognitive science.
150 pages | 6 x 9 | © 2022
Table of Contents
Introduction vii
1 Computational Morphology 1
Christo Kirov and Richard Sproat
2 Something Old, Something New: Grammar-based CCGb Parsing with Transformer Models 39
Stephen Clark
3 Probabilistic Lexical Semantics: From Gaussian Embeddings to Bernoulli Fields 65
Guy Emerson
4 The origins of vagueness 123
Peter Sutton
5 Bayesian Inference Semantics for Natural Language 159
Jean-Philippe Bernardy, Rasmus Blanck, Stergios Chatzikyriakidis, Shalom Lappin and Aleksandre Maskharashvili
6 Probabilistic pragmatics: A dialogical perspective 227
Bill Noble, Vladislav Maraev, and Ellen Breitholtz
7 Neuro-computation for Language processing 259
Vidya Somashekarappa
8 Learning Language Games Probabilistically: From Crying to Compositionality 283
Robin Cooper, Jonathan Ginzburg and Staffan Larsson
9 Distributional Semantics for Situated Spatial Language? Functional, Geometric and Perceptual Perspectives 319
John D. Kelleher and Simon Dobnik
10 Action coordination and learning in dialogue 357
Arash Eshghi, Christine Howes, and Eleni Gregoromichelaki
11 Reanalysis, probability, and the faculty of language 419
Asad B. Sayeed
Contributors 435
Glossary 439
1 Computational Morphology 1
Christo Kirov and Richard Sproat
2 Something Old, Something New: Grammar-based CCGb Parsing with Transformer Models 39
Stephen Clark
3 Probabilistic Lexical Semantics: From Gaussian Embeddings to Bernoulli Fields 65
Guy Emerson
4 The origins of vagueness 123
Peter Sutton
5 Bayesian Inference Semantics for Natural Language 159
Jean-Philippe Bernardy, Rasmus Blanck, Stergios Chatzikyriakidis, Shalom Lappin and Aleksandre Maskharashvili
6 Probabilistic pragmatics: A dialogical perspective 227
Bill Noble, Vladislav Maraev, and Ellen Breitholtz
7 Neuro-computation for Language processing 259
Vidya Somashekarappa
8 Learning Language Games Probabilistically: From Crying to Compositionality 283
Robin Cooper, Jonathan Ginzburg and Staffan Larsson
9 Distributional Semantics for Situated Spatial Language? Functional, Geometric and Perceptual Perspectives 319
John D. Kelleher and Simon Dobnik
10 Action coordination and learning in dialogue 357
Arash Eshghi, Christine Howes, and Eleni Gregoromichelaki
11 Reanalysis, probability, and the faculty of language 419
Asad B. Sayeed
Contributors 435
Glossary 439