Lessons on Parameter Sharing across Layers in Transformers.

Sho Takase Shun Kiyono

Published in: SustaiNLP (2023)

Keyphrases

information sharing
parameter values
multi layer
lessons learned
data sharing
database
neural network
machine learning
genetic algorithm
artificial neural networks
design parameters
information dissemination
single parameter
multiple layers
interactive video