Graph Inductive Biases in Transformers without Message Passing.
Liheng MaChen LinDerek LimAdriana Romero-SorianoPuneet K. DokaniaMark CoatesPhilip H. S. TorrSer-Nam LimPublished in: CoRR (2023)
Keyphrases
- message passing
- belief propagation
- distributed systems
- approximate inference
- shared memory
- junction tree
- probabilistic inference
- inference in graphical models
- singly connected
- factor graphs
- markov random field
- max product
- distributed shared memory
- sum product
- tree reweighted
- sum product algorithm
- ldpc codes
- graph cuts
- machine learning
- stereo matching
- linear programming
- higher order
- lower bound