Predictability and Surprise in Large Generative Models.
Deep GanguliDanny HernandezLiane LovittAmanda AskellYuntao BaiAnna ChenTom ConerlyNova DasSarmaDawn DrainNelson ElhageSheer El ShowkStanislav FortZac Hatfield-DoddsTom HenighanScott JohnstonAndy JonesNicholas JosephJackson KernianShauna KravecBen MannNeel NandaKamal NdousseCatherine OlssonDaniela AmodeiTom BrownJared KaplanSam McCandlishChristopher OlahDario AmodeiJack ClarkPublished in: FAccT (2022)
Keyphrases
- generative model
- probabilistic model
- mixture model
- discriminative learning
- prior knowledge
- generative and discriminative models
- discriminative models
- em algorithm
- conditional random fields
- semi supervised
- object categories
- boltzmann machine
- maximum entropy principle
- computer vision
- unsupervised learning
- expectation maximization
- topic models
- data sets