A Simple yet Effective Learnable Positional Encoding Method for Improving Document Transformer Model.
Guoxin WangYijuan LuLei CuiTengchao LvDinei A. F. FlorêncioCha ZhangPublished in: AACL/IJCNLP (Findings) (2022)
Keyphrases
- mathematical model
- statistical model
- high order
- classification algorithm
- cost function
- theoretical analysis
- prior information
- energy function
- test data
- similarity measure
- linear model
- probabilistic model
- input data
- em algorithm
- information retrieval
- clustering method
- objective function
- prior knowledge
- computational complexity
- classification method
- optimization method
- sensitivity analysis
- autoregressive
- probability distribution
- learning algorithm
- evaluation method
- uniform distribution
- modeling method
- neural network
- relevance model
- gaussian distribution
- bayesian framework
- web documents
- parameter estimation
- pairwise
- video sequences
- clustering algorithm