Generative Models as a Complex Systems Science: How can we make sense of large language model behavior?
Ari HoltzmanPeter WestLuke ZettlemoyerPublished in: CoRR (2023)
Keyphrases
- complex systems
- language model
- generative model
- probabilistic model
- mixture model
- language modeling
- emergent behavior
- n gram
- discriminative models
- agent based models
- document retrieval
- speech recognition
- graphical models
- multi agent systems
- bayesian framework
- discriminative learning
- retrieval model
- information retrieval
- bayesian networks
- latent dirichlet allocation
- conditional random fields
- em algorithm
- test collection
- query expansion
- expectation maximization
- latent variables
- translation model
- conditional probabilities
- prior knowledge
- vector space model
- query terms
- statistical machine translation
- semi supervised
- cooperative
- maximum likelihood