Lipschitz Constrained Parameter Initialization for Deep Transformers.

Hongfei Xu Qiuhui Liu Josef van Genabith Deyi Xiong Jingyi Zhang

Published in: ACL (2020)

Keyphrases

initial conditions
parameter settings
parameter values
support vector machine
pointwise
partial discharge
database
neural network
genetic algorithm
image segmentation
database systems
parameter space
input parameters
deep learning