Probabilistic Transformer: A Probabilistic Dependency Model for Contextual Word Representation.

Haoyi Wu Kewei Tu

Published in: CoRR (2023)

Keyphrases

probabilistic model
statistical model
objective function
high level
probabilistic interpretation
inference process

co occurrence
independence assumption
computational model
mathematical model
probabilistic formulation
joint probability

graphical representation
formal model
conceptual model
fuzzy logic
probability distribution

hidden markov models
keywords
multiscale
bayesian networks
similarity measure